2026-03-24 22:45:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-24 22:45:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-24 22:45:06 [ayvens.be] INFO: Starting spider ayvens.be
2026-03-24 22:45:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-24 22:45:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-24 22:45:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-24 22:45:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-24 22:45:06 [scrapy.extensions.telnet] INFO: Telnet Password: 4620b1543082ff81
2026-03-24 22:45:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-24 22:45:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.be/task_34_2026-03-24T22_45_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-24 22:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-24 22:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-24 22:45:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-24 22:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-24 22:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-24 22:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-24 22:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-24 22:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-24 22:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-24 22:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-24 22:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-24 22:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-24 22:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-24 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-24 22:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-24 22:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-24 22:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-24 22:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-24 22:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-24 22:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-24 22:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-24 22:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-24 22:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-24 22:45:12 [scrapy-playwright] INFO: Browser firefox launched
2026-03-24 22:45:12 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-24 22:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-24 22:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-24 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-24 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-24 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-24 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-24 22:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-24 22:45:19 [ayvens.be] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'XStAMjr0UsX0ZnPlLnVysU|2026-03-24T22:45:17.733Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1805928317, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'X9iFl66k9lhbR4sX/VfEyR|1774392319272|1774392319272', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774394119, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-24 22:45:19 [ayvens.be] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'XStAMjr0UsX0ZnPlLnVysU|2026-03-24T22:45:17.733Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'X9iFl66k9lhbR4sX/VfEyR|1774392319272|1774392319272', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-24 22:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-24 22:45:19 [ayvens.be] INFO: Intercepting token...
2026-03-24 22:45:19 [ayvens.be] INFO: Scrolling element to trigger lazy load...
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:19 [ayvens.be] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-24 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-24 22:45:20 [ayvens.be] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-24 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-24 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-24 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-24 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-24 22:45:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-24 22:45:21 [ayvens.be] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-24 22:45:21 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-24 22:45:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:45:24 [ayvens.be] INFO: Found listing with ID: 1981135
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981135%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [ayvens.be] INFO: Scrape type for 1981135: 1
2026-03-24 22:45:24 [ayvens.be] INFO: Extracting data for car ID: 1981135
2026-03-24 22:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135
2026-03-24 22:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79f9428e-091f-5f46-bb9e-7c3db70a593d with scrape type 1
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/1.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/2.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/3.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/4.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/5.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/6.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/7.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/8.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/9.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/10.jpg not downloaded yet
2026-03-24 22:45:24 [ayvens.be] INFO: Found listing with ID: 1981136
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981136%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [ayvens.be] INFO: Scrape type for 1981136: 1
2026-03-24 22:45:24 [ayvens.be] INFO: Extracting data for car ID: 1981136
2026-03-24 22:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136
2026-03-24 22:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ec57dc-bca1-51b9-9171-f999955cb521 with scrape type 1
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/1.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/2.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/3.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/4.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/5.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/6.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/7.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/8.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/9.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/10.jpg not downloaded yet
2026-03-24 22:45:24 [ayvens.be] INFO: Found listing with ID: 1981137
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981137%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [ayvens.be] INFO: Scrape type for 1981137: 1
2026-03-24 22:45:24 [ayvens.be] INFO: Extracting data for car ID: 1981137
2026-03-24 22:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137
2026-03-24 22:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a691153-75fd-5fd6-8d9c-90017e3894b2 with scrape type 1
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/1.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/2.jpg not downloaded yet
2026-03-24 22:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/3.jpg not downloaded yet
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/4.jpg not downloaded yet
2026-03-24 22:45:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/5.jpg not downloaded yet
2026-03-24 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/6.jpg not downloaded yet
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/7.jpg not downloaded yet
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/8.jpg not downloaded yet
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835ab10>
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2119
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/3.jpg saved to cache
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917ee50>
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/1.jpg saved to cache
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/9.jpg not downloaded yet
2026-03-24 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/10.jpg not downloaded yet
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b8390>
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/7.jpg saved to cache
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb4d0>
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/5.jpg saved to cache
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:25 [ayvens.be] INFO: Found listing with ID: 1981138
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981138%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [ayvens.be] INFO: Scrape type for 1981138: 1
2026-03-24 22:45:25 [ayvens.be] INFO: Extracting data for car ID: 1981138
2026-03-24 22:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138
2026-03-24 22:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dff7df-9b11-5d60-91fa-a74a269584dd with scrape type 1
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/1.jpg not downloaded yet
2026-03-24 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/2.jpg not downloaded yet
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916ee50>
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/4.jpg saved to cache
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008368b10>
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/6.jpg saved to cache
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009174d50>
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/8.jpg saved to cache
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/3.jpg not downloaded yet
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/4.jpg not downloaded yet
2026-03-24 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/5.jpg not downloaded yet
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009642d90>
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/10.jpg saved to cache
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ca510>
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/2.jpg saved to cache
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914f590>
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fc34862fd29da4fb69ce725054891ef02%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/9.jpg saved to cache
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79f9428e-091f-5f46-bb9e-7c3db70a593d
2026-03-24 22:45:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79f9428e-091f-5f46-bb9e-7c3db70a593d, skipping ID generation
2026-03-24 22:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79f9428e-091f-5f46-bb9e-7c3db70a593d with scrape type 1
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79f9428e-091f-5f46-bb9e-7c3db70a593d sending to next pipeline
2026-03-24 22:45:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 79f9428e-091f-5f46-bb9e-7c3db70a593d, identifier: 1981135
2026-03-24 22:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135
2026-03-24 22:45:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135
2026-03-24 22:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135 to the API
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '79f9428e-091f-5f46-bb9e-7c3db70a593d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 39734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79f9428e-091f-5f46-bb9e-7c3db70a593d/79f9428e-091f-5f46-bb9e-7c3db70a593d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/c34862fd29da4fb69ce725054891ef02/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 1.2 PURETECH 83 YOU ! MAN S-S',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 83 YOU ! MAN S-S',
 'vin': None,
 'year': 2023}
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981135%27 HTTP/1.1" 200 None
2026-03-24 22:45:26 [ayvens.be] INFO: Saving data for 1981135: {'created_time': 1774392326.917128, 'last_price_update_time': 1774392326.917139, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981135') HTTP/1.1" 204 0
2026-03-24 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/6.jpg not downloaded yet
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/7.jpg not downloaded yet
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009155fd0>
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/2.jpg saved to cache
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009142710>
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/1.jpg saved to cache
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/8.jpg not downloaded yet
2026-03-24 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/9.jpg not downloaded yet
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945fa50>
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/3.jpg saved to cache
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/10.jpg not downloaded yet
2026-03-24 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:27 [ayvens.be] INFO: Found listing with ID: 1981139
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981139%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [ayvens.be] INFO: Scrape type for 1981139: 1
2026-03-24 22:45:27 [ayvens.be] INFO: Extracting data for car ID: 1981139
2026-03-24 22:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139
2026-03-24 22:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e40e898-1a73-5900-a6ac-3adfd092d841 with scrape type 1
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/1.jpg not downloaded yet
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b1790>
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/1.jpg saved to cache
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfc710>
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/4.jpg saved to cache
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d03d0>
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/6.jpg saved to cache
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/2.jpg not downloaded yet
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/3.jpg not downloaded yet
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/4.jpg not downloaded yet
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836a550>
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/5.jpg saved to cache
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b77d0>
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/2.jpg saved to cache
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/5.jpg not downloaded yet
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/6.jpg not downloaded yet
2026-03-24 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aecfb90>
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/5.jpg saved to cache
2026-03-24 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf6d90>
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/4.jpg saved to cache
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/7.jpg not downloaded yet
2026-03-24 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/8.jpg not downloaded yet
2026-03-24 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/9.jpg not downloaded yet
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369bd0>
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/8.jpg saved to cache
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144b50>
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/7.jpg saved to cache
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/10.jpg not downloaded yet
2026-03-24 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:28 [ayvens.be] INFO: Found listing with ID: 1981140
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981140%27 HTTP/1.1" 200 None
2026-03-24 22:45:28 [ayvens.be] INFO: Scrape type for 1981140: 1
2026-03-24 22:45:28 [ayvens.be] INFO: Extracting data for car ID: 1981140
2026-03-24 22:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140
2026-03-24 22:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7ceea0-d793-598a-b897-0075675d2746 with scrape type 1
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/1.jpg not downloaded yet
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187010>
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/9.jpg saved to cache
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472d90>
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/3.jpg saved to cache
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009758110>
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/10.jpg saved to cache
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009471a90>
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2e7ce3e568ca4e36976d0dfccaa0cba8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/6.jpg saved to cache
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a691153-75fd-5fd6-8d9c-90017e3894b2
2026-03-24 22:45:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a691153-75fd-5fd6-8d9c-90017e3894b2, skipping ID generation
2026-03-24 22:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a691153-75fd-5fd6-8d9c-90017e3894b2 with scrape type 1
2026-03-24 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a691153-75fd-5fd6-8d9c-90017e3894b2 sending to next pipeline
2026-03-24 22:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2a691153-75fd-5fd6-8d9c-90017e3894b2, identifier: 1981137
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/2.jpg not downloaded yet
2026-03-24 22:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137
2026-03-24 22:45:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137
2026-03-24 22:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137 to the API
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2a691153-75fd-5fd6-8d9c-90017e3894b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 113121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a691153-75fd-5fd6-8d9c-90017e3894b2/2a691153-75fd-5fd6-8d9c-90017e3894b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2e7ce3e568ca4e36976d0dfccaa0cba8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981137%27 HTTP/1.1" 200 None
2026-03-24 22:45:29 [ayvens.be] INFO: Saving data for 1981137: {'created_time': 1774392329.486292, 'last_price_update_time': 1774392329.486304, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981137') HTTP/1.1" 204 0
2026-03-24 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/3.jpg not downloaded yet
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/4.jpg not downloaded yet
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009870950>
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/3.jpg saved to cache
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bd350>
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/4.jpg saved to cache
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/5.jpg not downloaded yet
2026-03-24 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/6.jpg not downloaded yet
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369a50>
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/5.jpg saved to cache
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/7.jpg not downloaded yet
2026-03-24 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/8.jpg not downloaded yet
2026-03-24 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/9.jpg not downloaded yet
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4e50>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/8.jpg saved to cache
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834c890>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/7.jpg saved to cache
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838fd90>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/9.jpg saved to cache
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3590>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/6.jpg saved to cache
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b6490>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/2.jpg saved to cache
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/10.jpg not downloaded yet
2026-03-24 22:45:30 [ayvens.be] INFO: Found listing with ID: 1981141
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981141%27 HTTP/1.1" 200 None
2026-03-24 22:45:30 [ayvens.be] INFO: Scrape type for 1981141: 1
2026-03-24 22:45:30 [ayvens.be] INFO: Extracting data for car ID: 1981141
2026-03-24 22:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141
2026-03-24 22:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd with scrape type 1
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/1.jpg not downloaded yet
2026-03-24 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2550>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/1.jpg saved to cache
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec4990>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/2.jpg saved to cache
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a77d0>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/4.jpg saved to cache
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/2.jpg not downloaded yet
2026-03-24 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/3.jpg not downloaded yet
2026-03-24 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/4.jpg not downloaded yet
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aa1d0>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/3.jpg saved to cache
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/5.jpg not downloaded yet
2026-03-24 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/6.jpg not downloaded yet
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915df90>
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/6.jpg saved to cache
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009157790>
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/5.jpg saved to cache
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962b710>
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/7.jpg saved to cache
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/7.jpg not downloaded yet
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/8.jpg not downloaded yet
2026-03-24 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/9.jpg not downloaded yet
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336950>
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/2.jpg saved to cache
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b0290>
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/8.jpg saved to cache
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8f90>
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/9.jpg saved to cache
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce790>
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F700059d01bcd4abf9235ec5b14822cc7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/10.jpg saved to cache
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e40e898-1a73-5900-a6ac-3adfd092d841
2026-03-24 22:45:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e40e898-1a73-5900-a6ac-3adfd092d841, skipping ID generation
2026-03-24 22:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e40e898-1a73-5900-a6ac-3adfd092d841 with scrape type 1
2026-03-24 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e40e898-1a73-5900-a6ac-3adfd092d841 sending to next pipeline
2026-03-24 22:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3e40e898-1a73-5900-a6ac-3adfd092d841, identifier: 1981139
2026-03-24 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139
2026-03-24 22:45:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139
2026-03-24 22:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139 to the API
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '3e40e898-1a73-5900-a6ac-3adfd092d841',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 44757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e40e898-1a73-5900-a6ac-3adfd092d841/3e40e898-1a73-5900-a6ac-3adfd092d841_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/700059d01bcd4abf9235ec5b14822cc7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981139%27 HTTP/1.1" 200 None
2026-03-24 22:45:32 [ayvens.be] INFO: Saving data for 1981139: {'created_time': 1774392332.388943, 'last_price_update_time': 1774392332.388953, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981139') HTTP/1.1" 204 0
2026-03-24 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/10.jpg not downloaded yet
2026-03-24 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008339210>
2026-03-24 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/1.jpg saved to cache
2026-03-24 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:32 [ayvens.be] INFO: Found listing with ID: 1981142
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981142%27 HTTP/1.1" 200 None
2026-03-24 22:45:32 [ayvens.be] INFO: Scrape type for 1981142: 1
2026-03-24 22:45:32 [ayvens.be] INFO: Extracting data for car ID: 1981142
2026-03-24 22:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142
2026-03-24 22:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with scrape type 1
2026-03-24 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/1.jpg not downloaded yet
2026-03-24 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2b8d0>
2026-03-24 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/4.jpg saved to cache
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096291d0>
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/3.jpg saved to cache
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144590>
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/9.jpg saved to cache
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c3d0>
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/5.jpg saved to cache
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/2.jpg not downloaded yet
2026-03-24 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/3.jpg not downloaded yet
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6ced90>
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/8.jpg saved to cache
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/4.jpg not downloaded yet
2026-03-24 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/5.jpg not downloaded yet
2026-03-24 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009185c90>
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/7.jpg saved to cache
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed0d50>
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/10.jpg saved to cache
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7e50>
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/10.jpg saved to cache
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/6.jpg not downloaded yet
2026-03-24 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/7.jpg not downloaded yet
2026-03-24 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/8.jpg not downloaded yet
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913cd10>
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39326ab3f4e4b6d98b0d2f8db17b82c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/6.jpg saved to cache
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e7ceea0-d793-598a-b897-0075675d2746
2026-03-24 22:45:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e7ceea0-d793-598a-b897-0075675d2746, skipping ID generation
2026-03-24 22:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7ceea0-d793-598a-b897-0075675d2746 with scrape type 1
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e7ceea0-d793-598a-b897-0075675d2746 sending to next pipeline
2026-03-24 22:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e7ceea0-d793-598a-b897-0075675d2746, identifier: 1981140
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830aad0>
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/2.jpg saved to cache
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a8ad0>
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/1.jpg saved to cache
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140
2026-03-24 22:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140
2026-03-24 22:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140 to the API
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6e7ceea0-d793-598a-b897-0075675d2746',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 123901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7ceea0-d793-598a-b897-0075675d2746/6e7ceea0-d793-598a-b897-0075675d2746_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39326ab3f4e4b6d98b0d2f8db17b82c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 E AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 E AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981140%27 HTTP/1.1" 200 None
2026-03-24 22:45:34 [ayvens.be] INFO: Saving data for 1981140: {'created_time': 1774392334.949015, 'last_price_update_time': 1774392334.949026, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981140') HTTP/1.1" 204 0
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/9.jpg not downloaded yet
2026-03-24 22:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/10.jpg not downloaded yet
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c8810>
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/3.jpg saved to cache
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914ef90>
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/4.jpg saved to cache
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:35 [ayvens.be] INFO: Found listing with ID: 1981143
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981143%27 HTTP/1.1" 200 None
2026-03-24 22:45:35 [ayvens.be] INFO: Scrape type for 1981143: 1
2026-03-24 22:45:35 [ayvens.be] INFO: Extracting data for car ID: 1981143
2026-03-24 22:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143
2026-03-24 22:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c with scrape type 1
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/1.jpg not downloaded yet
2026-03-24 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/2.jpg not downloaded yet
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009113210>
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe71e5a682dfd4601bee42f81bfbbe5f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/1.jpg saved to cache
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55dff7df-9b11-5d60-91fa-a74a269584dd
2026-03-24 22:45:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55dff7df-9b11-5d60-91fa-a74a269584dd, skipping ID generation
2026-03-24 22:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dff7df-9b11-5d60-91fa-a74a269584dd with scrape type 1
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55dff7df-9b11-5d60-91fa-a74a269584dd sending to next pipeline
2026-03-24 22:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55dff7df-9b11-5d60-91fa-a74a269584dd, identifier: 1981138
2026-03-24 22:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138
2026-03-24 22:45:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138
2026-03-24 22:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138 to the API
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '55dff7df-9b11-5d60-91fa-a74a269584dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 133256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55dff7df-9b11-5d60-91fa-a74a269584dd/55dff7df-9b11-5d60-91fa-a74a269584dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e71e5a682dfd4601bee42f81bfbbe5f5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 2.0 TDI 35 120KW S TRON. B. ED. SP',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 120KW S TRON. B. ED. SP',
 'vin': None,
 'year': 2020}
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981138%27 HTTP/1.1" 200 None
2026-03-24 22:45:35 [ayvens.be] INFO: Saving data for 1981138: {'created_time': 1774392335.772605, 'last_price_update_time': 1774392335.772615, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981138') HTTP/1.1" 204 0
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/3.jpg not downloaded yet
2026-03-24 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/4.jpg not downloaded yet
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2390>
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/6.jpg saved to cache
2026-03-24 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeafc50>
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/5.jpg saved to cache
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/5.jpg not downloaded yet
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d01b10>
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/8.jpg saved to cache
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b9850>
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/7.jpg saved to cache
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/6.jpg not downloaded yet
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/7.jpg not downloaded yet
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c24d0>
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/10.jpg saved to cache
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d2890>
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/9.jpg saved to cache
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a5bd0>
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/1.jpg saved to cache
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/8.jpg not downloaded yet
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/9.jpg not downloaded yet
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aa150>
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/9.jpg saved to cache
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914d1d0>
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/2.jpg saved to cache
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/10.jpg not downloaded yet
2026-03-24 22:45:36 [ayvens.be] INFO: Found listing with ID: 1981144
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981144%27 HTTP/1.1" 200 None
2026-03-24 22:45:36 [ayvens.be] INFO: Scrape type for 1981144: 1
2026-03-24 22:45:36 [ayvens.be] INFO: Extracting data for car ID: 1981144
2026-03-24 22:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144
2026-03-24 22:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with scrape type 1
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/1.jpg not downloaded yet
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/2.jpg not downloaded yet
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1c10>
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F55004d2ee560486e940519b078cddb39%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/10.jpg saved to cache
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd
2026-03-24 22:45:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e756c7e5-3ba1-5508-b45b-031fde5bc5dd, skipping ID generation
2026-03-24 22:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd with scrape type 1
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd sending to next pipeline
2026-03-24 22:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e756c7e5-3ba1-5508-b45b-031fde5bc5dd, identifier: 1981141
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c3190>
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/3.jpg saved to cache
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946fe10>
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/4.jpg saved to cache
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347410>
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/6.jpg saved to cache
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141
2026-03-24 22:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141
2026-03-24 22:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141 to the API
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e756c7e5-3ba1-5508-b45b-031fde5bc5dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 40457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 959193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 964219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e756c7e5-3ba1-5508-b45b-031fde5bc5dd/e756c7e5-3ba1-5508-b45b-031fde5bc5dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/55004d2ee560486e940519b078cddb39/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER 2.3 DCI 150 EN. BLUE GR CONFORT L2H2 35',
 'transmission': 'manual',
 'trim': '2.3 DCI 150 EN. BLUE GR CONFORT L2H2 35',
 'vin': None,
 'year': 2023}
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981141%27 HTTP/1.1" 200 None
2026-03-24 22:45:37 [ayvens.be] INFO: Saving data for 1981141: {'created_time': 1774392337.685238, 'last_price_update_time': 1774392337.685249, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981141') HTTP/1.1" 204 0
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/3.jpg not downloaded yet
2026-03-24 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/4.jpg not downloaded yet
2026-03-24 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ca850>
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/9.jpg saved to cache
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ad350>
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/7.jpg saved to cache
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/5.jpg not downloaded yet
2026-03-24 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/6.jpg not downloaded yet
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369390>
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/8.jpg saved to cache
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec4b10>
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/1.jpg saved to cache
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911cd50>
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/10.jpg saved to cache
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/7.jpg not downloaded yet
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/8.jpg not downloaded yet
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915d750>
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/5.jpg saved to cache
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310b50>
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/2.jpg saved to cache
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfdbd0>
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/8.jpg saved to cache
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/9.jpg not downloaded yet
2026-03-24 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/10.jpg not downloaded yet
2026-03-24 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:39 [ayvens.be] INFO: Found listing with ID: 1981145
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981145%27 HTTP/1.1" 200 None
2026-03-24 22:45:39 [ayvens.be] INFO: Scrape type for 1981145: 1
2026-03-24 22:45:39 [ayvens.be] INFO: Extracting data for car ID: 1981145
2026-03-24 22:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145
2026-03-24 22:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with scrape type 1
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/1.jpg not downloaded yet
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009011390>
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/3.jpg saved to cache
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916c4d0>
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/4.jpg saved to cache
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/2.jpg not downloaded yet
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00c8ed4d0>
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/6.jpg saved to cache
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009467b50>
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252F3d8854930ab34bfd910b9c7387f8ca90%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/5.jpg saved to cache
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110
2026-03-24 22:45:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 932ba259-a9f5-5bad-9ff0-16f2a67d1110, skipping ID generation
2026-03-24 22:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with scrape type 1
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110 sending to next pipeline
2026-03-24 22:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 932ba259-a9f5-5bad-9ff0-16f2a67d1110, identifier: 1981142
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6e0250>
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/8.jpg saved to cache
2026-03-24 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142
2026-03-24 22:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142
2026-03-24 22:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142 to the API
2026-03-24 22:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '932ba259-a9f5-5bad-9ff0-16f2a67d1110',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 61616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ba259-a9f5-5bad-9ff0-16f2a67d1110/932ba259-a9f5-5bad-9ff0-16f2a67d1110_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/3d8854930ab34bfd910b9c7387f8ca90/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 GT',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 GT',
 'vin': None,
 'year': 2021}
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981142%27 HTTP/1.1" 200 None
2026-03-24 22:45:40 [ayvens.be] INFO: Saving data for 1981142: {'created_time': 1774392340.125317, 'last_price_update_time': 1774392340.12533, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981142') HTTP/1.1" 204 0
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/3.jpg not downloaded yet
2026-03-24 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cdc10>
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/7.jpg saved to cache
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f9cd0>
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/1.jpg saved to cache
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2a6d0>
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/10.jpg saved to cache
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a310>
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fb8066f30768e465a9f3bb417df43e9a2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/9.jpg saved to cache
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c
2026-03-24 22:45:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7f49ce1-9cb3-5e49-8374-cacc8536af7c, skipping ID generation
2026-03-24 22:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c with scrape type 1
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c sending to next pipeline
2026-03-24 22:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7f49ce1-9cb3-5e49-8374-cacc8536af7c, identifier: 1981143
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/4.jpg not downloaded yet
2026-03-24 22:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143
2026-03-24 22:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143
2026-03-24 22:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143 to the API
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e7f49ce1-9cb3-5e49-8374-cacc8536af7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 116865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7f49ce1-9cb3-5e49-8374-cacc8536af7c/e7f49ce1-9cb3-5e49-8374-cacc8536af7c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/b8066f30768e465a9f3bb417df43e9a2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981143%27 HTTP/1.1" 200 None
2026-03-24 22:45:41 [ayvens.be] INFO: Saving data for 1981143: {'created_time': 1774392341.057917, 'last_price_update_time': 1774392341.057933, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981143') HTTP/1.1" 204 0
2026-03-24 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008311f10>
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/2.jpg saved to cache
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aa650>
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/3.jpg saved to cache
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/5.jpg not downloaded yet
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008398950>
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F97443f420b7a4810905ba2803446e932%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/7.jpg saved to cache
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46ec57dc-bca1-51b9-9171-f999955cb521
2026-03-24 22:45:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46ec57dc-bca1-51b9-9171-f999955cb521, skipping ID generation
2026-03-24 22:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ec57dc-bca1-51b9-9171-f999955cb521 with scrape type 1
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46ec57dc-bca1-51b9-9171-f999955cb521 sending to next pipeline
2026-03-24 22:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 46ec57dc-bca1-51b9-9171-f999955cb521, identifier: 1981136
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ccc90>
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/4.jpg saved to cache
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136
2026-03-24 22:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136
2026-03-24 22:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136 to the API
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '46ec57dc-bca1-51b9-9171-f999955cb521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 138625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ec57dc-bca1-51b9-9171-f999955cb521/46ec57dc-bca1-51b9-9171-f999955cb521_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/97443f420b7a4810905ba2803446e932/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2020}
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981136%27 HTTP/1.1" 200 None
2026-03-24 22:45:41 [ayvens.be] INFO: Saving data for 1981136: {'created_time': 1774392341.835887, 'last_price_update_time': 1774392341.835898, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981136') HTTP/1.1" 204 0
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/6.jpg not downloaded yet
2026-03-24 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946f710>
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/6.jpg saved to cache
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3f5a50>
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/5.jpg saved to cache
2026-03-24 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ca190>
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/8.jpg saved to cache
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343110>
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/7.jpg saved to cache
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/7.jpg not downloaded yet
2026-03-24 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/8.jpg not downloaded yet
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009397d10>
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/1.jpg saved to cache
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/9.jpg not downloaded yet
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/10.jpg not downloaded yet
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946cc50>
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/10.jpg saved to cache
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345e90>
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/2.jpg saved to cache
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473f90>
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F030a5cd219fe4645afb5aca4f05e6779%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/9.jpg saved to cache
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65
2026-03-24 22:45:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65, skipping ID generation
2026-03-24 22:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with scrape type 1
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 sending to next pipeline
2026-03-24 22:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65, identifier: 1981144
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343590>
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/3.jpg saved to cache
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:42 [ayvens.be] INFO: Found listing with ID: 1981146
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981146%27 HTTP/1.1" 200 None
2026-03-24 22:45:42 [ayvens.be] INFO: Scrape type for 1981146: 1
2026-03-24 22:45:42 [ayvens.be] INFO: Extracting data for car ID: 1981146
2026-03-24 22:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146
2026-03-24 22:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with scrape type 1
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/1.jpg not downloaded yet
2026-03-24 22:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144
2026-03-24 22:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144
2026-03-24 22:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144 to the API
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e99ef99f-7fc5-5a59-9b9d-3745dc92bd65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 126429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e99ef99f-7fc5-5a59-9b9d-3745dc92bd65/e99ef99f-7fc5-5a59-9b9d-3745dc92bd65_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/030a5cd219fe4645afb5aca4f05e6779/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981144%27 HTTP/1.1" 200 None
2026-03-24 22:45:42 [ayvens.be] INFO: Saving data for 1981144: {'created_time': 1774392342.981161, 'last_price_update_time': 1774392342.981172, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981144') HTTP/1.1" 204 0
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/2.jpg not downloaded yet
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bff4f50>
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/4.jpg saved to cache
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/3.jpg not downloaded yet
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/4.jpg not downloaded yet
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/5.jpg not downloaded yet
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/6.jpg not downloaded yet
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b1a90>
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/6.jpg saved to cache
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/7.jpg not downloaded yet
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009156b50>
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/5.jpg saved to cache
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/8.jpg not downloaded yet
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00ca66390>
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/7.jpg saved to cache
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009177790>
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/8.jpg saved to cache
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091569d0>
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/9.jpg saved to cache
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/9.jpg not downloaded yet
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/10.jpg not downloaded yet
2026-03-24 22:45:43 [ayvens.be] INFO: Found listing with ID: 1981147
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981147%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [ayvens.be] INFO: Scrape type for 1981147: 1
2026-03-24 22:45:43 [ayvens.be] INFO: Extracting data for car ID: 1981147
2026-03-24 22:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147
2026-03-24 22:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d383ddfc-c6f8-58f9-8819-387d76fdbede with scrape type 1
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/1.jpg not downloaded yet
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/2.jpg not downloaded yet
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/3.jpg not downloaded yet
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/4.jpg not downloaded yet
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c4d0>
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F097bac00603f4fe6b5cc787e6c83bbb7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/10.jpg saved to cache
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8
2026-03-24 22:45:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75831d27-db1a-57be-b9a4-6b8922f3a7f8, skipping ID generation
2026-03-24 22:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with scrape type 1
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8 sending to next pipeline
2026-03-24 22:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 75831d27-db1a-57be-b9a4-6b8922f3a7f8, identifier: 1981145
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/5.jpg not downloaded yet
2026-03-24 22:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145
2026-03-24 22:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145
2026-03-24 22:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145 to the API
2026-03-24 22:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '75831d27-db1a-57be-b9a4-6b8922f3a7f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 75263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75831d27-db1a-57be-b9a4-6b8922f3a7f8/75831d27-db1a-57be-b9a4-6b8922f3a7f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/097bac00603f4fe6b5cc787e6c83bbb7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 AMBITION',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 AMBITION',
 'vin': None,
 'year': 2021}
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981145%27 HTTP/1.1" 200 None
2026-03-24 22:45:44 [ayvens.be] INFO: Saving data for 1981145: {'created_time': 1774392344.203996, 'last_price_update_time': 1774392344.204009, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981145') HTTP/1.1" 204 0
2026-03-24 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/6.jpg not downloaded yet
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae890>
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/1.jpg saved to cache
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915cd50>
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/5.jpg saved to cache
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911f4d0>
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/3.jpg saved to cache
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914d550>
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/4.jpg saved to cache
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d8e50>
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/2.jpg saved to cache
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/7.jpg not downloaded yet
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/8.jpg not downloaded yet
2026-03-24 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834cd50>
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/6.jpg saved to cache
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/9.jpg not downloaded yet
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/10.jpg not downloaded yet
2026-03-24 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:44 [ayvens.be] INFO: Found listing with ID: 1981148
2026-03-24 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981148%27 HTTP/1.1" 200 None
2026-03-24 22:45:45 [ayvens.be] INFO: Scrape type for 1981148: 1
2026-03-24 22:45:45 [ayvens.be] INFO: Extracting data for car ID: 1981148
2026-03-24 22:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148
2026-03-24 22:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with scrape type 1
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/1.jpg not downloaded yet
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfd350>
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/7.jpg saved to cache
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911e3d0>
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/8.jpg saved to cache
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/2.jpg not downloaded yet
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/3.jpg not downloaded yet
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347dd0>
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/1.jpg saved to cache
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cff710>
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/2.jpg saved to cache
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/4.jpg not downloaded yet
2026-03-24 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/5.jpg not downloaded yet
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c2150>
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/10.jpg saved to cache
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4410>
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F32d2b041182e4e3684c65934b3c678de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/9.jpg saved to cache
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7
2026-03-24 22:45:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c80c1a2f-015a-5969-ab5d-64b9e6a66da7, skipping ID generation
2026-03-24 22:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with scrape type 1
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7 sending to next pipeline
2026-03-24 22:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c80c1a2f-015a-5969-ab5d-64b9e6a66da7, identifier: 1981146
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009118090>
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/3.jpg saved to cache
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/6.jpg not downloaded yet
2026-03-24 22:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146
2026-03-24 22:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146
2026-03-24 22:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146 to the API
2026-03-24 22:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c80c1a2f-015a-5969-ab5d-64b9e6a66da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 126846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c80c1a2f-015a-5969-ab5d-64b9e6a66da7/c80c1a2f-015a-5969-ab5d-64b9e6a66da7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/32d2b041182e4e3684c65934b3c678de/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981146%27 HTTP/1.1" 200 None
2026-03-24 22:45:46 [ayvens.be] INFO: Saving data for 1981146: {'created_time': 1774392346.312486, 'last_price_update_time': 1774392346.312495, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981146') HTTP/1.1" 204 0
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/7.jpg not downloaded yet
2026-03-24 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/8.jpg not downloaded yet
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0090089d0>
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/4.jpg saved to cache
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945d6d0>
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/5.jpg saved to cache
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/9.jpg not downloaded yet
2026-03-24 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/10.jpg not downloaded yet
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083156d0>
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/6.jpg saved to cache
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0490>
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/1.jpg saved to cache
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1850>
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/2.jpg saved to cache
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:46 [ayvens.be] INFO: Found listing with ID: 1981149
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981149%27 HTTP/1.1" 200 None
2026-03-24 22:45:46 [ayvens.be] INFO: Scrape type for 1981149: 1
2026-03-24 22:45:46 [ayvens.be] INFO: Extracting data for car ID: 1981149
2026-03-24 22:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149
2026-03-24 22:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95495680-c237-5901-b6dc-368b4f2bde71 with scrape type 1
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/1.jpg not downloaded yet
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a0c90>
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/3.jpg saved to cache
2026-03-24 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962ad90>
2026-03-24 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/10.jpg saved to cache
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310990>
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/8.jpg saved to cache
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/2.jpg not downloaded yet
2026-03-24 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/3.jpg not downloaded yet
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d8fd0>
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/9.jpg saved to cache
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ada10>
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa40ecd7a80004cdeb17ac037d3752b7b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/7.jpg saved to cache
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d383ddfc-c6f8-58f9-8819-387d76fdbede
2026-03-24 22:45:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d383ddfc-c6f8-58f9-8819-387d76fdbede, skipping ID generation
2026-03-24 22:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d383ddfc-c6f8-58f9-8819-387d76fdbede with scrape type 1
2026-03-24 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d383ddfc-c6f8-58f9-8819-387d76fdbede sending to next pipeline
2026-03-24 22:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d383ddfc-c6f8-58f9-8819-387d76fdbede, identifier: 1981147
2026-03-24 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147
2026-03-24 22:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147
2026-03-24 22:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147 to the API
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd383ddfc-c6f8-58f9-8819-387d76fdbede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 87676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d383ddfc-c6f8-58f9-8819-387d76fdbede/d383ddfc-c6f8-58f9-8819-387d76fdbede_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a40ecd7a80004cdeb17ac037d3752b7b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 96KW S-S GT PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S GT PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981147%27 HTTP/1.1" 200 None
2026-03-24 22:45:48 [ayvens.be] INFO: Saving data for 1981147: {'created_time': 1774392348.212917, 'last_price_update_time': 1774392348.212927, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981147') HTTP/1.1" 204 0
2026-03-24 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/4.jpg not downloaded yet
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440690>
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/8.jpg saved to cache
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093db150>
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/4.jpg saved to cache
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/5.jpg not downloaded yet
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b7ce810>
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/5.jpg saved to cache
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911a8d0>
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/6.jpg saved to cache
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/6.jpg not downloaded yet
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009471250>
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/7.jpg saved to cache
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/7.jpg not downloaded yet
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f7150>
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/9.jpg saved to cache
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083384d0>
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252Ff0feea3ee5274f7c82e80090c1870f2b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/10.jpg saved to cache
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37
2026-03-24 22:45:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95c75bc2-fcb0-517e-8e3c-23cf7736db37, skipping ID generation
2026-03-24 22:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with scrape type 1
2026-03-24 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37 sending to next pipeline
2026-03-24 22:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 95c75bc2-fcb0-517e-8e3c-23cf7736db37, identifier: 1981148
2026-03-24 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/8.jpg not downloaded yet
2026-03-24 22:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148
2026-03-24 22:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148
2026-03-24 22:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148 to the API
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '95c75bc2-fcb0-517e-8e3c-23cf7736db37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 190552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c75bc2-fcb0-517e-8e3c-23cf7736db37/95c75bc2-fcb0-517e-8e3c-23cf7736db37_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/f0feea3ee5274f7c82e80090c1870f2b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 TE PHEV R-Design DCT STOCK',
 'transmission': 'automatic',
 'trim': '1.5 T5 TE PHEV R-Design DCT STOCK',
 'vin': None,
 'year': 2020}
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981148%27 HTTP/1.1" 200 None
2026-03-24 22:45:49 [ayvens.be] INFO: Saving data for 1981148: {'created_time': 1774392349.406868, 'last_price_update_time': 1774392349.406877, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981148') HTTP/1.1" 204 0
2026-03-24 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/9.jpg not downloaded yet
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838fed0>
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/1.jpg saved to cache
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839a990>
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/2.jpg saved to cache
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/10.jpg not downloaded yet
2026-03-24 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:49 [ayvens.be] INFO: Found listing with ID: 1981150
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981150%27 HTTP/1.1" 200 None
2026-03-24 22:45:49 [ayvens.be] INFO: Scrape type for 1981150: 1
2026-03-24 22:45:49 [ayvens.be] INFO: Extracting data for car ID: 1981150
2026-03-24 22:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150
2026-03-24 22:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d18c03-5a70-52d6-8f3a-d501780a05bb with scrape type 1
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/1.jpg not downloaded yet
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911a390>
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/3.jpg saved to cache
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/2.jpg not downloaded yet
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094586d0>
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/4.jpg saved to cache
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/3.jpg not downloaded yet
2026-03-24 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442750>
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/5.jpg saved to cache
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/4.jpg not downloaded yet
2026-03-24 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/5.jpg not downloaded yet
2026-03-24 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009141c50>
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/7.jpg saved to cache
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/6.jpg not downloaded yet
2026-03-24 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/7.jpg not downloaded yet
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083390d0>
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/6.jpg saved to cache
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093da1d0>
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/8.jpg saved to cache
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915c5d0>
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/10.jpg saved to cache
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/8.jpg not downloaded yet
2026-03-24 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/9.jpg not downloaded yet
2026-03-24 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b7a10>
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Ffd2e76782907405dbc35924f1c345eaf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/9.jpg saved to cache
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95495680-c237-5901-b6dc-368b4f2bde71
2026-03-24 22:45:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95495680-c237-5901-b6dc-368b4f2bde71, skipping ID generation
2026-03-24 22:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95495680-c237-5901-b6dc-368b4f2bde71 with scrape type 1
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95495680-c237-5901-b6dc-368b4f2bde71 sending to next pipeline
2026-03-24 22:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 95495680-c237-5901-b6dc-368b4f2bde71, identifier: 1981149
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/10.jpg not downloaded yet
2026-03-24 22:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149
2026-03-24 22:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149
2026-03-24 22:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149 to the API
2026-03-24 22:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '95495680-c237-5901-b6dc-368b4f2bde71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 164034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95495680-c237-5901-b6dc-368b4f2bde71/95495680-c237-5901-b6dc-368b4f2bde71_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/fd2e76782907405dbc35924f1c345eaf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981149%27 HTTP/1.1" 200 None
2026-03-24 22:45:51 [ayvens.be] INFO: Saving data for 1981149: {'created_time': 1774392351.239466, 'last_price_update_time': 1774392351.239475, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981149') HTTP/1.1" 204 0
2026-03-24 22:45:51 [ayvens.be] INFO: Found listing with ID: 1981151
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981151%27 HTTP/1.1" 200 None
2026-03-24 22:45:51 [ayvens.be] INFO: Scrape type for 1981151: 1
2026-03-24 22:45:51 [ayvens.be] INFO: Extracting data for car ID: 1981151
2026-03-24 22:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151
2026-03-24 22:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c73026-a151-5067-8118-8a4478549aa2 with scrape type 1
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/1.jpg not downloaded yet
2026-03-24 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009567a10>
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/1.jpg saved to cache
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a8c10>
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/2.jpg saved to cache
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/2.jpg not downloaded yet
2026-03-24 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/3.jpg not downloaded yet
2026-03-24 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144650>
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/5.jpg saved to cache
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/4.jpg not downloaded yet
2026-03-24 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/5.jpg not downloaded yet
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464dd0>
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/3.jpg saved to cache
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a2bd0>
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/4.jpg saved to cache
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093facd0>
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/6.jpg saved to cache
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/6.jpg not downloaded yet
2026-03-24 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/7.jpg not downloaded yet
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009143c10>
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/7.jpg saved to cache
2026-03-24 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008398910>
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/8.jpg saved to cache
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a0cd0>
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/9.jpg saved to cache
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/8.jpg not downloaded yet
2026-03-24 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/9.jpg not downloaded yet
2026-03-24 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083987d0>
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uc%252Fd4d9ce8b04b94a748e226061bc4abf40%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/10.jpg saved to cache
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67d18c03-5a70-52d6-8f3a-d501780a05bb
2026-03-24 22:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67d18c03-5a70-52d6-8f3a-d501780a05bb, skipping ID generation
2026-03-24 22:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d18c03-5a70-52d6-8f3a-d501780a05bb with scrape type 1
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67d18c03-5a70-52d6-8f3a-d501780a05bb sending to next pipeline
2026-03-24 22:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67d18c03-5a70-52d6-8f3a-d501780a05bb, identifier: 1981150
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/10.jpg not downloaded yet
2026-03-24 22:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150
2026-03-24 22:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150
2026-03-24 22:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150 to the API
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '67d18c03-5a70-52d6-8f3a-d501780a05bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 33608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d18c03-5a70-52d6-8f3a-d501780a05bb/67d18c03-5a70-52d6-8f3a-d501780a05bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uc/d4d9ce8b04b94a748e226061bc4abf40/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-04',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981150%27 HTTP/1.1" 200 None
2026-03-24 22:45:52 [ayvens.be] INFO: Saving data for 1981150: {'created_time': 1774392352.904018, 'last_price_update_time': 1774392352.904028, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981150') HTTP/1.1" 204 0
2026-03-24 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:52 [ayvens.be] INFO: Found listing with ID: 1981152
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981152%27 HTTP/1.1" 200 None
2026-03-24 22:45:52 [ayvens.be] INFO: Scrape type for 1981152: 1
2026-03-24 22:45:52 [ayvens.be] INFO: Extracting data for car ID: 1981152
2026-03-24 22:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152
2026-03-24 22:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd809381-d151-5296-b62b-a4d865d26fdf with scrape type 1
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/1.jpg not downloaded yet
2026-03-24 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945b510>
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/1.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c24d0>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/2.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009642010>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/3.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/2.jpg not downloaded yet
2026-03-24 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/3.jpg not downloaded yet
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096101d0>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/4.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914f110>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/5.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/4.jpg not downloaded yet
2026-03-24 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/5.jpg not downloaded yet
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915e6d0>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/6.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0090188d0>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/7.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/6.jpg not downloaded yet
2026-03-24 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/7.jpg not downloaded yet
2026-03-24 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009465010>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/8.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2bfd0>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/9.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/8.jpg not downloaded yet
2026-03-24 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/9.jpg not downloaded yet
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834dc90>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F95bd03f71add429ba46dd08c7b35ffba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/10.jpg saved to cache
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2c73026-a151-5067-8118-8a4478549aa2
2026-03-24 22:45:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2c73026-a151-5067-8118-8a4478549aa2, skipping ID generation
2026-03-24 22:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c73026-a151-5067-8118-8a4478549aa2 with scrape type 1
2026-03-24 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2c73026-a151-5067-8118-8a4478549aa2 sending to next pipeline
2026-03-24 22:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b2c73026-a151-5067-8118-8a4478549aa2, identifier: 1981151
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008311010>
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/1.jpg saved to cache
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/10.jpg not downloaded yet
2026-03-24 22:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151
2026-03-24 22:45:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151
2026-03-24 22:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151 to the API
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'color': 'SKYSCRAPER GRAU',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b2c73026-a151-5067-8118-8a4478549aa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 57590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c73026-a151-5067-8118-8a4478549aa2/b2c73026-a151-5067-8118-8a4478549aa2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/95bd03f71add429ba46dd08c7b35ffba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 215KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 215KW AUTO',
 'vin': None,
 'year': 2023}
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981151%27 HTTP/1.1" 200 None
2026-03-24 22:45:54 [ayvens.be] INFO: Saving data for 1981151: {'created_time': 1774392354.444965, 'last_price_update_time': 1774392354.444974, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981151') HTTP/1.1" 204 0
2026-03-24 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:54 [ayvens.be] INFO: Found listing with ID: 1981153
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981153%27 HTTP/1.1" 200 None
2026-03-24 22:45:54 [ayvens.be] INFO: Scrape type for 1981153: 1
2026-03-24 22:45:54 [ayvens.be] INFO: Extracting data for car ID: 1981153
2026-03-24 22:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153
2026-03-24 22:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba with scrape type 1
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/1.jpg not downloaded yet
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095640d0>
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/2.jpg saved to cache
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915d5d0>
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/3.jpg saved to cache
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/2.jpg not downloaded yet
2026-03-24 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/3.jpg not downloaded yet
2026-03-24 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008c93e10>
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/4.jpg saved to cache
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/4.jpg not downloaded yet
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/5.jpg not downloaded yet
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094abf10>
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/5.jpg saved to cache
2026-03-24 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b06d0>
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/6.jpg saved to cache
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317c50>
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/7.jpg saved to cache
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/6.jpg not downloaded yet
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b06d0>
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/8.jpg saved to cache
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/7.jpg not downloaded yet
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/8.jpg not downloaded yet
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed8050>
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/9.jpg saved to cache
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/9.jpg not downloaded yet
2026-03-24 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915f550>
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/1.jpg saved to cache
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/10.jpg not downloaded yet
2026-03-24 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:55 [ayvens.be] INFO: Found listing with ID: 1981154
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981154%27 HTTP/1.1" 200 None
2026-03-24 22:45:55 [ayvens.be] INFO: Scrape type for 1981154: 1
2026-03-24 22:45:55 [ayvens.be] INFO: Extracting data for car ID: 1981154
2026-03-24 22:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154
2026-03-24 22:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with scrape type 1
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/1.jpg not downloaded yet
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440650>
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/3.jpg saved to cache
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b2b10>
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/2.jpg saved to cache
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d2ed0>
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F9fb81e999d904180a626d98c6e119b04%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/10.jpg saved to cache
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd809381-d151-5296-b62b-a4d865d26fdf
2026-03-24 22:45:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd809381-d151-5296-b62b-a4d865d26fdf, skipping ID generation
2026-03-24 22:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd809381-d151-5296-b62b-a4d865d26fdf with scrape type 1
2026-03-24 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd809381-d151-5296-b62b-a4d865d26fdf sending to next pipeline
2026-03-24 22:45:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cd809381-d151-5296-b62b-a4d865d26fdf, identifier: 1981152
2026-03-24 22:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152
2026-03-24 22:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152
2026-03-24 22:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152 to the API
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cd809381-d151-5296-b62b-a4d865d26fdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 91724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd809381-d151-5296-b62b-a4d865d26fdf/cd809381-d151-5296-b62b-a4d865d26fdf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/9fb81e999d904180a626d98c6e119b04/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 MHEV 116KW ACENTA XTRONIC',
 'transmission': 'automatic',
 'trim': '1.3 MHEV 116KW ACENTA XTRONIC',
 'vin': None,
 'year': 2023}
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981152%27 HTTP/1.1" 200 None
2026-03-24 22:45:56 [ayvens.be] INFO: Saving data for 1981152: {'created_time': 1774392356.262048, 'last_price_update_time': 1774392356.262057, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981152') HTTP/1.1" 204 0
2026-03-24 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/2.jpg not downloaded yet
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091566d0>
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/4.jpg saved to cache
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685b10>
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/6.jpg saved to cache
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/3.jpg not downloaded yet
2026-03-24 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/4.jpg not downloaded yet
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083277d0>
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/5.jpg saved to cache
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/5.jpg not downloaded yet
2026-03-24 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/6.jpg not downloaded yet
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed8790>
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/7.jpg saved to cache
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/7.jpg not downloaded yet
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d003d0>
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/8.jpg saved to cache
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009758290>
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/9.jpg saved to cache
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/8.jpg not downloaded yet
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b297210>
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F26039620c56847cdac95dc407c9fa0da%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/10.jpg saved to cache
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba
2026-03-24 22:45:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2eb5f30-0659-59ec-97ca-b4d7614e8aba, skipping ID generation
2026-03-24 22:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba with scrape type 1
2026-03-24 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba sending to next pipeline
2026-03-24 22:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2eb5f30-0659-59ec-97ca-b4d7614e8aba, identifier: 1981153
2026-03-24 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/9.jpg not downloaded yet
2026-03-24 22:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153
2026-03-24 22:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153
2026-03-24 22:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153 to the API
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a2eb5f30-0659-59ec-97ca-b4d7614e8aba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 48318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2eb5f30-0659-59ec-97ca-b4d7614e8aba/a2eb5f30-0659-59ec-97ca-b4d7614e8aba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/26039620c56847cdac95dc407c9fa0da/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'vin': None,
 'year': 2022}
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981153%27 HTTP/1.1" 200 None
2026-03-24 22:45:57 [ayvens.be] INFO: Saving data for 1981153: {'created_time': 1774392357.339076, 'last_price_update_time': 1774392357.339087, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981153') HTTP/1.1" 204 0
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b6790>
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/1.jpg saved to cache
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/10.jpg not downloaded yet
2026-03-24 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d9f50>
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/2.jpg saved to cache
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:57 [ayvens.be] INFO: Found listing with ID: 1981155
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981155%27 HTTP/1.1" 200 None
2026-03-24 22:45:57 [ayvens.be] INFO: Scrape type for 1981155: 1
2026-03-24 22:45:57 [ayvens.be] INFO: Extracting data for car ID: 1981155
2026-03-24 22:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155
2026-03-24 22:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d9d405-e816-59b5-8743-cae75190dd16 with scrape type 1
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/1.jpg not downloaded yet
2026-03-24 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/2.jpg not downloaded yet
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6b50>
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/3.jpg saved to cache
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2110>
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/4.jpg saved to cache
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441d10>
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/5.jpg saved to cache
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/3.jpg not downloaded yet
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440690>
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/6.jpg saved to cache
2026-03-24 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1450>
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/7.jpg saved to cache
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/4.jpg not downloaded yet
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/5.jpg not downloaded yet
2026-03-24 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/6.jpg not downloaded yet
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/7.jpg not downloaded yet
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/8.jpg not downloaded yet
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/9.jpg not downloaded yet
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/10.jpg not downloaded yet
2026-03-24 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:58 [ayvens.be] INFO: Found listing with ID: 1981156
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981156%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [ayvens.be] INFO: Scrape type for 1981156: 1
2026-03-24 22:45:58 [ayvens.be] INFO: Extracting data for car ID: 1981156
2026-03-24 22:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156
2026-03-24 22:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a9001d-4382-56d9-8dea-163a7a9c475a with scrape type 1
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/1.jpg not downloaded yet
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/2.jpg not downloaded yet
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915cad0>
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/8.jpg saved to cache
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3a90>
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/9.jpg saved to cache
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464ad0>
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F12c010e98acb4ff3bbbae60d8edbeb16%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/10.jpg saved to cache
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d
2026-03-24 22:45:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d, skipping ID generation
2026-03-24 22:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with scrape type 1
2026-03-24 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d sending to next pipeline
2026-03-24 22:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d, identifier: 1981154
2026-03-24 22:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154
2026-03-24 22:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154
2026-03-24 22:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154 to the API
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '30fa89c7-74f2-5738-9f5a-2c2b02344a0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 101522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30fa89c7-74f2-5738-9f5a-2c2b02344a0d/30fa89c7-74f2-5738-9f5a-2c2b02344a0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/12c010e98acb4ff3bbbae60d8edbeb16/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 PureTech PHEV Shine S&S',
 'transmission': 'automatic',
 'trim': '1.6 PureTech PHEV Shine S&S',
 'vin': None,
 'year': 2020}
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981154%27 HTTP/1.1" 200 None
2026-03-24 22:45:58 [ayvens.be] INFO: Saving data for 1981154: {'created_time': 1774392358.96782, 'last_price_update_time': 1774392358.967831, 'auction_closing_time': 1774855800.0}
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981154') HTTP/1.1" 204 0
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/3.jpg not downloaded yet
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/4.jpg not downloaded yet
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083837d0>
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/1.jpg saved to cache
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/5.jpg not downloaded yet
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/6.jpg not downloaded yet
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/7.jpg not downloaded yet
2026-03-24 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/8.jpg not downloaded yet
2026-03-24 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/9.jpg not downloaded yet
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945ca50>
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/7.jpg saved to cache
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009687410>
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/4.jpg saved to cache
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334d50>
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/5.jpg saved to cache
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836b410>
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/6.jpg saved to cache
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/10.jpg not downloaded yet
2026-03-24 22:45:59 [ayvens.be] INFO: Found listing with ID: 1981157
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981157%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [ayvens.be] INFO: Scrape type for 1981157: 1
2026-03-24 22:46:00 [ayvens.be] INFO: Extracting data for car ID: 1981157
2026-03-24 22:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157
2026-03-24 22:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de6e15d-a6a6-5347-8ee9-97962eae7102 with scrape type 1
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/1.jpg not downloaded yet
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/2.jpg not downloaded yet
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334250>
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/3.jpg saved to cache
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359410>
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/2.jpg saved to cache
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d9d0>
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/8.jpg saved to cache
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfe390>
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/9.jpg saved to cache
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/3.jpg not downloaded yet
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/4.jpg not downloaded yet
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/5.jpg not downloaded yet
2026-03-24 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/6.jpg not downloaded yet
2026-03-24 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/7.jpg not downloaded yet
2026-03-24 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/8.jpg not downloaded yet
2026-03-24 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/9.jpg not downloaded yet
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/10.jpg not downloaded yet
2026-03-24 22:46:00 [ayvens.be] INFO: Found listing with ID: 1981158
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981158%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [ayvens.be] INFO: Scrape type for 1981158: 1
2026-03-24 22:46:00 [ayvens.be] INFO: Extracting data for car ID: 1981158
2026-03-24 22:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158
2026-03-24 22:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with scrape type 1
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/1.jpg not downloaded yet
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369d10>
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ffd6cade12efc43f28fda399866d5b06a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/10.jpg saved to cache
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40d9d405-e816-59b5-8743-cae75190dd16
2026-03-24 22:46:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40d9d405-e816-59b5-8743-cae75190dd16, skipping ID generation
2026-03-24 22:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d9d405-e816-59b5-8743-cae75190dd16 with scrape type 1
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40d9d405-e816-59b5-8743-cae75190dd16 sending to next pipeline
2026-03-24 22:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 40d9d405-e816-59b5-8743-cae75190dd16, identifier: 1981155
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/2.jpg not downloaded yet
2026-03-24 22:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155
2026-03-24 22:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155
2026-03-24 22:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155 to the API
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '40d9d405-e816-59b5-8743-cae75190dd16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 93963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40d9d405-e816-59b5-8743-cae75190dd16/40d9d405-e816-59b5-8743-cae75190dd16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 849612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/fd6cade12efc43f28fda399866d5b06a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981155%27 HTTP/1.1" 200 None
2026-03-24 22:46:01 [ayvens.be] INFO: Saving data for 1981155: {'created_time': 1774392361.295842, 'last_price_update_time': 1774392361.295853, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981155') HTTP/1.1" 204 0
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838cad0>
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/2.jpg saved to cache
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472950>
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/3.jpg saved to cache
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873150>
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/5.jpg saved to cache
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083694d0>
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/1.jpg saved to cache
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009404b10>
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/4.jpg saved to cache
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/3.jpg not downloaded yet
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938f750>
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/7.jpg saved to cache
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bf150>
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/6.jpg saved to cache
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/4.jpg not downloaded yet
2026-03-24 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/5.jpg not downloaded yet
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/6.jpg not downloaded yet
2026-03-24 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/7.jpg not downloaded yet
2026-03-24 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/8.jpg not downloaded yet
2026-03-24 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/9.jpg not downloaded yet
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c8c50>
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/1.jpg saved to cache
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338f10>
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/2.jpg saved to cache
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008358090>
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/4.jpg saved to cache
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b190>
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/3.jpg saved to cache
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/10.jpg not downloaded yet
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e990>
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/8.jpg saved to cache
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009008e90>
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/9.jpg saved to cache
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145950>
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F3c7862c1132d4bcb9a985153e975507f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/10.jpg saved to cache
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79a9001d-4382-56d9-8dea-163a7a9c475a
2026-03-24 22:46:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79a9001d-4382-56d9-8dea-163a7a9c475a, skipping ID generation
2026-03-24 22:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a9001d-4382-56d9-8dea-163a7a9c475a with scrape type 1
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79a9001d-4382-56d9-8dea-163a7a9c475a sending to next pipeline
2026-03-24 22:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 79a9001d-4382-56d9-8dea-163a7a9c475a, identifier: 1981156
2026-03-24 22:46:02 [ayvens.be] INFO: Found listing with ID: 1981159
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981159%27 HTTP/1.1" 200 None
2026-03-24 22:46:02 [ayvens.be] INFO: Scrape type for 1981159: 1
2026-03-24 22:46:02 [ayvens.be] INFO: Extracting data for car ID: 1981159
2026-03-24 22:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159
2026-03-24 22:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc8ad3b-0a22-5704-af7f-eb08498cc608 with scrape type 1
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/1.jpg not downloaded yet
2026-03-24 22:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156
2026-03-24 22:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156
2026-03-24 22:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156 to the API
2026-03-24 22:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '79a9001d-4382-56d9-8dea-163a7a9c475a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 86513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 822656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 890982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 887265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a9001d-4382-56d9-8dea-163a7a9c475a/79a9001d-4382-56d9-8dea-163a7a9c475a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 859855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/3c7862c1132d4bcb9a985153e975507f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981156%27 HTTP/1.1" 200 None
2026-03-24 22:46:03 [ayvens.be] INFO: Saving data for 1981156: {'created_time': 1774392363.220389, 'last_price_update_time': 1774392363.220399, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981156') HTTP/1.1" 204 0
2026-03-24 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/2.jpg not downloaded yet
2026-03-24 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/3.jpg not downloaded yet
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/4.jpg not downloaded yet
2026-03-24 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/5.jpg not downloaded yet
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/6.jpg not downloaded yet
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008c93f10>
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/10.jpg saved to cache
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ba9d0>
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/9.jpg saved to cache
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a3a50>
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/8.jpg saved to cache
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b9390>
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/6.jpg saved to cache
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493290>
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/7.jpg saved to cache
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/7.jpg not downloaded yet
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836bad0>
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/3.jpg saved to cache
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359590>
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/2.jpg saved to cache
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a1150>
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/1.jpg saved to cache
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/8.jpg not downloaded yet
2026-03-24 22:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/9.jpg not downloaded yet
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/10.jpg not downloaded yet
2026-03-24 22:46:04 [ayvens.be] INFO: Found listing with ID: 1981160
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981160%27 HTTP/1.1" 200 None
2026-03-24 22:46:04 [ayvens.be] INFO: Scrape type for 1981160: 1
2026-03-24 22:46:04 [ayvens.be] INFO: Extracting data for car ID: 1981160
2026-03-24 22:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160
2026-03-24 22:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8921c252-c828-5ada-af84-a5834b0a35cf with scrape type 1
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/1.jpg not downloaded yet
2026-03-24 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/2.jpg not downloaded yet
2026-03-24 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/3.jpg not downloaded yet
2026-03-24 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119790>
2026-03-24 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fc44190c18ab3468b9b0b9b815c901ddb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/5.jpg saved to cache
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7de6e15d-a6a6-5347-8ee9-97962eae7102
2026-03-24 22:46:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7de6e15d-a6a6-5347-8ee9-97962eae7102, skipping ID generation
2026-03-24 22:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de6e15d-a6a6-5347-8ee9-97962eae7102 with scrape type 1
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7de6e15d-a6a6-5347-8ee9-97962eae7102 sending to next pipeline
2026-03-24 22:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7de6e15d-a6a6-5347-8ee9-97962eae7102, identifier: 1981157
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/4.jpg not downloaded yet
2026-03-24 22:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157
2026-03-24 22:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157
2026-03-24 22:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157 to the API
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7de6e15d-a6a6-5347-8ee9-97962eae7102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 92277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de6e15d-a6a6-5347-8ee9-97962eae7102/7de6e15d-a6a6-5347-8ee9-97962eae7102_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/c44190c18ab3468b9b0b9b815c901ddb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981157%27 HTTP/1.1" 200 None
2026-03-24 22:46:05 [ayvens.be] INFO: Saving data for 1981157: {'created_time': 1774392365.077413, 'last_price_update_time': 1774392365.077422, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981157') HTTP/1.1" 204 0
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/5.jpg not downloaded yet
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008368dd0>
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/10.jpg saved to cache
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b297210>
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/5.jpg saved to cache
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008337fd0>
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/6.jpg saved to cache
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b83d0>
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/9.jpg saved to cache
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009146f10>
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/4.jpg saved to cache
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008344890>
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/7.jpg saved to cache
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083379d0>
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F43197a74193a448c9ed8434a20eb735e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/8.jpg saved to cache
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3
2026-03-24 22:46:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3, skipping ID generation
2026-03-24 22:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with scrape type 1
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 sending to next pipeline
2026-03-24 22:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3, identifier: 1981158
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/6.jpg not downloaded yet
2026-03-24 22:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158
2026-03-24 22:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158
2026-03-24 22:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158 to the API
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 171872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3/c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/43197a74193a448c9ed8434a20eb735e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981158%27 HTTP/1.1" 200 None
2026-03-24 22:46:06 [ayvens.be] INFO: Saving data for 1981158: {'created_time': 1774392366.228704, 'last_price_update_time': 1774392366.228713, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981158') HTTP/1.1" 204 0
2026-03-24 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/7.jpg not downloaded yet
2026-03-24 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/8.jpg not downloaded yet
2026-03-24 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/9.jpg not downloaded yet
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/10.jpg not downloaded yet
2026-03-24 22:46:06 [ayvens.be] INFO: Found listing with ID: 1981161
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981161%27 HTTP/1.1" 200 None
2026-03-24 22:46:06 [ayvens.be] INFO: Scrape type for 1981161: 1
2026-03-24 22:46:06 [ayvens.be] INFO: Extracting data for car ID: 1981161
2026-03-24 22:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161
2026-03-24 22:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2fc17eb-8cc4-5060-a30b-08e075170d4d with scrape type 1
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/1.jpg not downloaded yet
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/2.jpg not downloaded yet
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009154150>
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/6.jpg saved to cache
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c7990>
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/8.jpg saved to cache
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945ef50>
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/5.jpg saved to cache
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009012450>
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/7.jpg saved to cache
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/3.jpg not downloaded yet
2026-03-24 22:46:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 6 pages/min), scraped 24 items (at 24 items/min)
2026-03-24 22:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094656d0>
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/4.jpg saved to cache
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913fa50>
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/1.jpg saved to cache
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf4f90>
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/2.jpg saved to cache
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/4.jpg not downloaded yet
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/5.jpg not downloaded yet
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ba990>
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/3.jpg saved to cache
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/6.jpg not downloaded yet
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/7.jpg not downloaded yet
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946efd0>
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/6.jpg saved to cache
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/8.jpg not downloaded yet
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/9.jpg not downloaded yet
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/10.jpg not downloaded yet
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091124d0>
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/1.jpg saved to cache
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b6210>
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/3.jpg saved to cache
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685190>
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/5.jpg saved to cache
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec42d0>
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/10.jpg saved to cache
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f090>
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F80978292f0ad49bda33b71287effdffd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/9.jpg saved to cache
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfc8ad3b-0a22-5704-af7f-eb08498cc608
2026-03-24 22:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfc8ad3b-0a22-5704-af7f-eb08498cc608, skipping ID generation
2026-03-24 22:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc8ad3b-0a22-5704-af7f-eb08498cc608 with scrape type 1
2026-03-24 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfc8ad3b-0a22-5704-af7f-eb08498cc608 sending to next pipeline
2026-03-24 22:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bfc8ad3b-0a22-5704-af7f-eb08498cc608, identifier: 1981159
2026-03-24 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bb9ab50>
2026-03-24 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/2.jpg saved to cache
2026-03-24 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bcd50>
2026-03-24 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/4.jpg saved to cache
2026-03-24 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159
2026-03-24 22:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159
2026-03-24 22:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159 to the API
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'bfc8ad3b-0a22-5704-af7f-eb08498cc608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 50569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc8ad3b-0a22-5704-af7f-eb08498cc608/bfc8ad3b-0a22-5704-af7f-eb08498cc608_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/80978292f0ad49bda33b71287effdffd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981159%27 HTTP/1.1" 200 None
2026-03-24 22:46:09 [ayvens.be] INFO: Saving data for 1981159: {'created_time': 1774392369.032312, 'last_price_update_time': 1774392369.032321, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981159') HTTP/1.1" 204 0
2026-03-24 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:09 [ayvens.be] INFO: Found listing with ID: 1981162
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981162%27 HTTP/1.1" 200 None
2026-03-24 22:46:09 [ayvens.be] INFO: Scrape type for 1981162: 1
2026-03-24 22:46:09 [ayvens.be] INFO: Extracting data for car ID: 1981162
2026-03-24 22:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162
2026-03-24 22:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3768bda1-7314-5a71-83e5-60dfb18d6a21 with scrape type 1
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/1.jpg not downloaded yet
2026-03-24 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/2.jpg not downloaded yet
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1bb890>
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/10.jpg saved to cache
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013c50>
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/3.jpg saved to cache
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830a610>
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/1.jpg saved to cache
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0e50>
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/7.jpg saved to cache
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830a750>
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/8.jpg saved to cache
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/3.jpg not downloaded yet
2026-03-24 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/4.jpg not downloaded yet
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d4250>
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F28cd7b220a30454baca6c907b64bcc49%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/9.jpg saved to cache
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8921c252-c828-5ada-af84-a5834b0a35cf
2026-03-24 22:46:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8921c252-c828-5ada-af84-a5834b0a35cf, skipping ID generation
2026-03-24 22:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8921c252-c828-5ada-af84-a5834b0a35cf with scrape type 1
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8921c252-c828-5ada-af84-a5834b0a35cf sending to next pipeline
2026-03-24 22:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8921c252-c828-5ada-af84-a5834b0a35cf, identifier: 1981160
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836ba50>
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/2.jpg saved to cache
2026-03-24 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160
2026-03-24 22:46:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160
2026-03-24 22:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160 to the API
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8921c252-c828-5ada-af84-a5834b0a35cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON DIESEL - 2017',
 'odometer': 84412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8921c252-c828-5ada-af84-a5834b0a35cf/8921c252-c828-5ada-af84-a5834b0a35cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/28cd7b220a30454baca6c907b64bcc49/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON DIESEL - 2017 2.0 CR TDi Move! Ultimate DSG',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi Move! Ultimate DSG',
 'vin': None,
 'year': 2020}
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981160%27 HTTP/1.1" 200 None
2026-03-24 22:46:10 [ayvens.be] INFO: Saving data for 1981160: {'created_time': 1774392370.035216, 'last_price_update_time': 1774392370.035227, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981160') HTTP/1.1" 204 0
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/5.jpg not downloaded yet
2026-03-24 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c0a50>
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/4.jpg saved to cache
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915cd50>
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/7.jpg saved to cache
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343950>
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/6.jpg saved to cache
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009156410>
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/5.jpg saved to cache
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/6.jpg not downloaded yet
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/7.jpg not downloaded yet
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfe750>
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/10.jpg saved to cache
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/8.jpg not downloaded yet
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/9.jpg not downloaded yet
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835bb90>
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/9.jpg saved to cache
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aa0d0>
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1ef4c2668e5d450a887aa62afb4cbd7e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/8.jpg saved to cache
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2fc17eb-8cc4-5060-a30b-08e075170d4d
2026-03-24 22:46:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2fc17eb-8cc4-5060-a30b-08e075170d4d, skipping ID generation
2026-03-24 22:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2fc17eb-8cc4-5060-a30b-08e075170d4d with scrape type 1
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2fc17eb-8cc4-5060-a30b-08e075170d4d sending to next pipeline
2026-03-24 22:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2fc17eb-8cc4-5060-a30b-08e075170d4d, identifier: 1981161
2026-03-24 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/10.jpg not downloaded yet
2026-03-24 22:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161
2026-03-24 22:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161
2026-03-24 22:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161 to the API
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 39,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd2fc17eb-8cc4-5060-a30b-08e075170d4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 60204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2fc17eb-8cc4-5060-a30b-08e075170d4d/d2fc17eb-8cc4-5060-a30b-08e075170d4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1ef4c2668e5d450a887aa62afb4cbd7e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981161%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [ayvens.be] INFO: Saving data for 1981161: {'created_time': 1774392371.303155, 'last_price_update_time': 1774392371.303164, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981161') HTTP/1.1" 204 0
2026-03-24 22:46:11 [ayvens.be] INFO: Found listing with ID: 1981163
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981163%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [ayvens.be] INFO: Scrape type for 1981163: 1
2026-03-24 22:46:11 [ayvens.be] INFO: Extracting data for car ID: 1981163
2026-03-24 22:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163
2026-03-24 22:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 633de39c-557a-5914-acd1-c2a22f2cf2b7 with scrape type 1
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/1.jpg not downloaded yet
2026-03-24 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912b650>
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/2.jpg saved to cache
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912b5d0>
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/1.jpg saved to cache
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/2.jpg not downloaded yet
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/3.jpg not downloaded yet
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/4.jpg not downloaded yet
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b2b10>
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/3.jpg saved to cache
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/5.jpg not downloaded yet
2026-03-24 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/6.jpg not downloaded yet
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/7.jpg not downloaded yet
2026-03-24 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/8.jpg not downloaded yet
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/9.jpg not downloaded yet
2026-03-24 22:46:11 [ayvens.be] INFO: Found listing with ID: 1981164
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981164%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [ayvens.be] INFO: Scrape type for 1981164: 1
2026-03-24 22:46:11 [ayvens.be] INFO: Extracting data for car ID: 1981164
2026-03-24 22:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164
2026-03-24 22:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea36366-becb-52d6-adf2-de44265f70ba with scrape type 1
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/1.jpg not downloaded yet
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/2.jpg not downloaded yet
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd910>
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/6.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917f0d0>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/7.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a0690>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/4.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1ba650>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/5.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838f210>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/8.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a4850>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/9.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/3.jpg not downloaded yet
2026-03-24 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/4.jpg not downloaded yet
2026-03-24 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/5.jpg not downloaded yet
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910e890>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/1.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/6.jpg not downloaded yet
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119b10>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/3.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/7.jpg not downloaded yet
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/8.jpg not downloaded yet
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c01d0>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/2.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec5310>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/4.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a29650>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/7.jpg saved to cache
2026-03-24 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334610>
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/6.jpg saved to cache
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02090>
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/8.jpg saved to cache
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3850>
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F7ecbdeb80ce1484283a8640f38de66d8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/10.jpg saved to cache
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3768bda1-7314-5a71-83e5-60dfb18d6a21
2026-03-24 22:46:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3768bda1-7314-5a71-83e5-60dfb18d6a21, skipping ID generation
2026-03-24 22:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3768bda1-7314-5a71-83e5-60dfb18d6a21 with scrape type 1
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3768bda1-7314-5a71-83e5-60dfb18d6a21 sending to next pipeline
2026-03-24 22:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3768bda1-7314-5a71-83e5-60dfb18d6a21, identifier: 1981162
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008337490>
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/5.jpg saved to cache
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/9.jpg not downloaded yet
2026-03-24 22:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162
2026-03-24 22:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162
2026-03-24 22:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162 to the API
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3768bda1-7314-5a71-83e5-60dfb18d6a21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI - 2020',
 'odometer': 125754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3768bda1-7314-5a71-83e5-60dfb18d6a21/3768bda1-7314-5a71-83e5-60dfb18d6a21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/7ecbdeb80ce1484283a8640f38de66d8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI - 2020 1.5 TSI Style',
 'transmission': 'manual',
 'trim': '1.5 TSI Style',
 'vin': None,
 'year': 2020}
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981162%27 HTTP/1.1" 200 None
2026-03-24 22:46:13 [ayvens.be] INFO: Saving data for 1981162: {'created_time': 1774392373.982268, 'last_price_update_time': 1774392373.982278, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981162') HTTP/1.1" 204 0
2026-03-24 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/10.jpg not downloaded yet
2026-03-24 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:14 [ayvens.be] INFO: Found listing with ID: 1981165
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981165%27 HTTP/1.1" 200 None
2026-03-24 22:46:14 [ayvens.be] INFO: Scrape type for 1981165: 1
2026-03-24 22:46:14 [ayvens.be] INFO: Extracting data for car ID: 1981165
2026-03-24 22:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165
2026-03-24 22:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with scrape type 1
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/1.jpg not downloaded yet
2026-03-24 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/2.jpg not downloaded yet
2026-03-24 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/3.jpg not downloaded yet
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/4.jpg not downloaded yet
2026-03-24 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d4210>
2026-03-24 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fec28f296db8e477eb11f385f1c7fb1e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/9.jpg saved to cache
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 633de39c-557a-5914-acd1-c2a22f2cf2b7
2026-03-24 22:46:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 633de39c-557a-5914-acd1-c2a22f2cf2b7, skipping ID generation
2026-03-24 22:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 633de39c-557a-5914-acd1-c2a22f2cf2b7 with scrape type 1
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 633de39c-557a-5914-acd1-c2a22f2cf2b7 sending to next pipeline
2026-03-24 22:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 633de39c-557a-5914-acd1-c2a22f2cf2b7, identifier: 1981163
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/5.jpg not downloaded yet
2026-03-24 22:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163
2026-03-24 22:46:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163
2026-03-24 22:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163 to the API
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'MYTHOSZWART METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '633de39c-557a-5914-acd1-c2a22f2cf2b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 63981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_633de39c-557a-5914-acd1-c2a22f2cf2b7/633de39c-557a-5914-acd1-c2a22f2cf2b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/ec28f296db8e477eb11f385f1c7fb1e6/images/large/9.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 2.0 35 TDI S TRONIC QUATTRO',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC QUATTRO',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981163%27 HTTP/1.1" 200 None
2026-03-24 22:46:15 [ayvens.be] INFO: Saving data for 1981163: {'created_time': 1774392375.101855, 'last_price_update_time': 1774392375.101866, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981163') HTTP/1.1" 204 0
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ada50>
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/3.jpg saved to cache
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/6.jpg not downloaded yet
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2090>
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/2.jpg saved to cache
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d2950>
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/6.jpg saved to cache
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009467410>
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/4.jpg saved to cache
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406d50>
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/5.jpg saved to cache
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d2a10>
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/1.jpg saved to cache
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407e90>
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/7.jpg saved to cache
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/7.jpg not downloaded yet
2026-03-24 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/8.jpg not downloaded yet
2026-03-24 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/9.jpg not downloaded yet
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/10.jpg not downloaded yet
2026-03-24 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:15 [ayvens.be] INFO: Found listing with ID: 1981166
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981166%27 HTTP/1.1" 200 None
2026-03-24 22:46:15 [ayvens.be] INFO: Scrape type for 1981166: 1
2026-03-24 22:46:15 [ayvens.be] INFO: Extracting data for car ID: 1981166
2026-03-24 22:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166
2026-03-24 22:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82784532-457f-558d-bc1b-25ccb11a7de7 with scrape type 1
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/1.jpg not downloaded yet
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/2.jpg not downloaded yet
2026-03-24 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ad2d0>
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/10.jpg saved to cache
2026-03-24 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d5d10>
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/9.jpg saved to cache
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/3.jpg not downloaded yet
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd2d0>
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F802da14689e94af88c8d300d8d277fd9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/8.jpg saved to cache
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ea36366-becb-52d6-adf2-de44265f70ba
2026-03-24 22:46:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ea36366-becb-52d6-adf2-de44265f70ba, skipping ID generation
2026-03-24 22:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea36366-becb-52d6-adf2-de44265f70ba with scrape type 1
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ea36366-becb-52d6-adf2-de44265f70ba sending to next pipeline
2026-03-24 22:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2ea36366-becb-52d6-adf2-de44265f70ba, identifier: 1981164
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/4.jpg not downloaded yet
2026-03-24 22:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164
2026-03-24 22:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164
2026-03-24 22:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164 to the API
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2ea36366-becb-52d6-adf2-de44265f70ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 42910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 416452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea36366-becb-52d6-adf2-de44265f70ba/2ea36366-becb-52d6-adf2-de44265f70ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/802da14689e94af88c8d300d8d277fd9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 96KW S-S GT',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S GT',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981164%27 HTTP/1.1" 200 None
2026-03-24 22:46:16 [ayvens.be] INFO: Saving data for 1981164: {'created_time': 1774392376.659302, 'last_price_update_time': 1774392376.659312, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981164') HTTP/1.1" 204 0
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009640710>
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/2.jpg saved to cache
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910e110>
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/1.jpg saved to cache
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c0c90>
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/3.jpg saved to cache
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2b50>
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/4.jpg saved to cache
2026-03-24 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/5.jpg not downloaded yet
2026-03-24 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/6.jpg not downloaded yet
2026-03-24 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/7.jpg not downloaded yet
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/8.jpg not downloaded yet
2026-03-24 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/9.jpg not downloaded yet
2026-03-24 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/10.jpg not downloaded yet
2026-03-24 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:17 [ayvens.be] INFO: Found listing with ID: 1981167
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981167%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [ayvens.be] INFO: Scrape type for 1981167: 1
2026-03-24 22:46:17 [ayvens.be] INFO: Extracting data for car ID: 1981167
2026-03-24 22:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167
2026-03-24 22:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26fb0bb8-171f-523e-a686-3a59b11a0599 with scrape type 1
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/1.jpg not downloaded yet
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/2.jpg not downloaded yet
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c27d0>
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/5.jpg saved to cache
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/3.jpg not downloaded yet
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009395590>
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/6.jpg saved to cache
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/4.jpg not downloaded yet
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b2050>
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/7.jpg saved to cache
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091237d0>
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/8.jpg saved to cache
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008342bd0>
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/10.jpg saved to cache
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945ae10>
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F4a4d8bbb0aab40fcb18e3e6e457c8737%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/9.jpg saved to cache
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0
2026-03-24 22:46:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0, skipping ID generation
2026-03-24 22:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with scrape type 1
2026-03-24 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 sending to next pipeline
2026-03-24 22:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0, identifier: 1981165
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cfed0>
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/1.jpg saved to cache
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009123250>
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/2.jpg saved to cache
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/5.jpg not downloaded yet
2026-03-24 22:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165
2026-03-24 22:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165
2026-03-24 22:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165 to the API
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '86cae8a2-90d4-5ee6-8835-6f25660ee9f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX',
 'odometer': 62278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86cae8a2-90d4-5ee6-8835-6f25660ee9f0/86cae8a2-90d4-5ee6-8835-6f25660ee9f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/4a4d8bbb0aab40fcb18e3e6e457c8737/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX BEV 77KWH XDRIVE40',
 'transmission': 'automatic',
 'trim': 'BEV 77KWH XDRIVE40',
 'vin': None,
 'year': 2023}
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981165%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [ayvens.be] INFO: Saving data for 1981165: {'created_time': 1774392378.632645, 'last_price_update_time': 1774392378.632655, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981165') HTTP/1.1" 204 0
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/6.jpg not downloaded yet
2026-03-24 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/7.jpg not downloaded yet
2026-03-24 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/8.jpg not downloaded yet
2026-03-24 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/9.jpg not downloaded yet
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/10.jpg not downloaded yet
2026-03-24 22:46:18 [ayvens.be] INFO: Found listing with ID: 1981168
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981168%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [ayvens.be] INFO: Scrape type for 1981168: 1
2026-03-24 22:46:18 [ayvens.be] INFO: Extracting data for car ID: 1981168
2026-03-24 22:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168
2026-03-24 22:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e06512cd-663b-5bfc-81eb-1250f1e387e6 with scrape type 1
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/1.jpg not downloaded yet
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/2.jpg not downloaded yet
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6ced50>
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/3.jpg saved to cache
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405590>
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/5.jpg saved to cache
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/3.jpg not downloaded yet
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fa150>
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/4.jpg saved to cache
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6cfc10>
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/7.jpg saved to cache
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/4.jpg not downloaded yet
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/5.jpg not downloaded yet
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b55d0>
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/6.jpg saved to cache
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639ad0>
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/8.jpg saved to cache
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/6.jpg not downloaded yet
2026-03-24 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/7.jpg not downloaded yet
2026-03-24 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641e90>
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/3.jpg saved to cache
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/8.jpg not downloaded yet
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/9.jpg not downloaded yet
2026-03-24 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/10.jpg not downloaded yet
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0c50>
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/2.jpg saved to cache
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce0d0>
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/1.jpg saved to cache
2026-03-24 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911df10>
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/4.jpg saved to cache
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28290>
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/10.jpg saved to cache
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d5a50>
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/6.jpg saved to cache
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0550>
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/5.jpg saved to cache
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:20 [ayvens.be] INFO: Found listing with ID: 1981169
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981169%27 HTTP/1.1" 200 None
2026-03-24 22:46:20 [ayvens.be] INFO: Scrape type for 1981169: 1
2026-03-24 22:46:20 [ayvens.be] INFO: Extracting data for car ID: 1981169
2026-03-24 22:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169
2026-03-24 22:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with scrape type 1
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/1.jpg not downloaded yet
2026-03-24 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/2.jpg not downloaded yet
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009122f10>
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F86dc7202984f4f838f4bd3cf918755ec%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/9.jpg saved to cache
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82784532-457f-558d-bc1b-25ccb11a7de7
2026-03-24 22:46:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82784532-457f-558d-bc1b-25ccb11a7de7, skipping ID generation
2026-03-24 22:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82784532-457f-558d-bc1b-25ccb11a7de7 with scrape type 1
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82784532-457f-558d-bc1b-25ccb11a7de7 sending to next pipeline
2026-03-24 22:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82784532-457f-558d-bc1b-25ccb11a7de7, identifier: 1981166
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/3.jpg not downloaded yet
2026-03-24 22:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166
2026-03-24 22:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166
2026-03-24 22:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166 to the API
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '82784532-457f-558d-bc1b-25ccb11a7de7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'C40',
 'odometer': 74098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 837789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82784532-457f-558d-bc1b-25ccb11a7de7/82784532-457f-558d-bc1b-25ccb11a7de7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/86dc7202984f4f838f4bd3cf918755ec/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO C40 BEV 78KWH RECHARGE TWIN ULTIMATE',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH RECHARGE TWIN ULTIMATE',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981166%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [ayvens.be] INFO: Saving data for 1981166: {'created_time': 1774392381.077474, 'last_price_update_time': 1774392381.077484, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981166') HTTP/1.1" 204 0
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/4.jpg not downloaded yet
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008368c10>
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/7.jpg saved to cache
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/5.jpg not downloaded yet
2026-03-24 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/6.jpg not downloaded yet
2026-03-24 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/7.jpg not downloaded yet
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/8.jpg not downloaded yet
2026-03-24 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/9.jpg not downloaded yet
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/10.jpg not downloaded yet
2026-03-24 22:46:21 [ayvens.be] INFO: Found listing with ID: 1981170
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981170%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [ayvens.be] INFO: Scrape type for 1981170: 1
2026-03-24 22:46:21 [ayvens.be] INFO: Extracting data for car ID: 1981170
2026-03-24 22:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170
2026-03-24 22:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf74b177-c79e-5671-9cc0-4f2599309342 with scrape type 1
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/1.jpg not downloaded yet
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839be90>
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/8.jpg saved to cache
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/2.jpg not downloaded yet
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd050>
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/2.jpg saved to cache
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7e90>
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/10.jpg saved to cache
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0196da9d0>
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/3.jpg saved to cache
2026-03-24 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28810>
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F4a9309a1e41d47458db83b4d49b7b6b1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/9.jpg saved to cache
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26fb0bb8-171f-523e-a686-3a59b11a0599
2026-03-24 22:46:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26fb0bb8-171f-523e-a686-3a59b11a0599, skipping ID generation
2026-03-24 22:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26fb0bb8-171f-523e-a686-3a59b11a0599 with scrape type 1
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26fb0bb8-171f-523e-a686-3a59b11a0599 sending to next pipeline
2026-03-24 22:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26fb0bb8-171f-523e-a686-3a59b11a0599, identifier: 1981167
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493410>
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/1.jpg saved to cache
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/3.jpg not downloaded yet
2026-03-24 22:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167
2026-03-24 22:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167
2026-03-24 22:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167 to the API
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '26fb0bb8-171f-523e-a686-3a59b11a0599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 73894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26fb0bb8-171f-523e-a686-3a59b11a0599/26fb0bb8-171f-523e-a686-3a59b11a0599_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/4a9309a1e41d47458db83b4d49b7b6b1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW) Model Advantage Business',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW) Model Advantage Business',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981167%27 HTTP/1.1" 200 None
2026-03-24 22:46:22 [ayvens.be] INFO: Saving data for 1981167: {'created_time': 1774392382.620115, 'last_price_update_time': 1774392382.620124, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981167') HTTP/1.1" 204 0
2026-03-24 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6e0390>
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/5.jpg saved to cache
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913d790>
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/4.jpg saved to cache
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/4.jpg not downloaded yet
2026-03-24 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/5.jpg not downloaded yet
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110090>
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/1.jpg saved to cache
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/6.jpg not downloaded yet
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/7.jpg not downloaded yet
2026-03-24 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/8.jpg not downloaded yet
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009130650>
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/2.jpg saved to cache
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/9.jpg not downloaded yet
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/10.jpg not downloaded yet
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c35d0>
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/7.jpg saved to cache
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394d50>
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/3.jpg saved to cache
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639ad0>
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/10.jpg saved to cache
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834f610>
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/6.jpg saved to cache
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cda50>
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/9.jpg saved to cache
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008344d10>
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/4.jpg saved to cache
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:23 [ayvens.be] INFO: Found listing with ID: 1981171
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981171%27 HTTP/1.1" 200 None
2026-03-24 22:46:23 [ayvens.be] INFO: Scrape type for 1981171: 1
2026-03-24 22:46:23 [ayvens.be] INFO: Extracting data for car ID: 1981171
2026-03-24 22:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171
2026-03-24 22:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with scrape type 1
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/1.jpg not downloaded yet
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/2.jpg not downloaded yet
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed8910>
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1a4639d48d7141bd8239ad7f572bdb3f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/8.jpg saved to cache
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e06512cd-663b-5bfc-81eb-1250f1e387e6
2026-03-24 22:46:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e06512cd-663b-5bfc-81eb-1250f1e387e6, skipping ID generation
2026-03-24 22:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e06512cd-663b-5bfc-81eb-1250f1e387e6 with scrape type 1
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e06512cd-663b-5bfc-81eb-1250f1e387e6 sending to next pipeline
2026-03-24 22:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e06512cd-663b-5bfc-81eb-1250f1e387e6, identifier: 1981168
2026-03-24 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/3.jpg not downloaded yet
2026-03-24 22:46:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168
2026-03-24 22:46:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168
2026-03-24 22:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168 to the API
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e06512cd-663b-5bfc-81eb-1250f1e387e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 59559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 907805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06512cd-663b-5bfc-81eb-1250f1e387e6/e06512cd-663b-5bfc-81eb-1250f1e387e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1a4639d48d7141bd8239ad7f572bdb3f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.5 TURBO ECOTEC D 96KW S-S ULTIMATE',
 'transmission': 'manual',
 'trim': '1.5 TURBO ECOTEC D 96KW S-S ULTIMATE',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981168%27 HTTP/1.1" 200 None
2026-03-24 22:46:24 [ayvens.be] INFO: Saving data for 1981168: {'created_time': 1774392384.256174, 'last_price_update_time': 1774392384.256185, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981168') HTTP/1.1" 204 0
2026-03-24 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/4.jpg not downloaded yet
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175e10>
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/5.jpg saved to cache
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009191f50>
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/6.jpg saved to cache
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b4c90>
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/10.jpg saved to cache
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/5.jpg not downloaded yet
2026-03-24 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/6.jpg not downloaded yet
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009421d10>
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/9.jpg saved to cache
2026-03-24 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009467a50>
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/8.jpg saved to cache
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/7.jpg not downloaded yet
2026-03-24 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/8.jpg not downloaded yet
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b1810>
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/2.jpg saved to cache
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121f90>
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/3.jpg saved to cache
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/9.jpg not downloaded yet
2026-03-24 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/10.jpg not downloaded yet
2026-03-24 22:46:25 [ayvens.be] INFO: Found listing with ID: 1981172
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981172%27 HTTP/1.1" 200 None
2026-03-24 22:46:25 [ayvens.be] INFO: Scrape type for 1981172: 1
2026-03-24 22:46:25 [ayvens.be] INFO: Extracting data for car ID: 1981172
2026-03-24 22:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172
2026-03-24 22:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with scrape type 1
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/1.jpg not downloaded yet
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd790>
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/1.jpg saved to cache
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564450>
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F176551032170435282657753dc32930e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/7.jpg saved to cache
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5
2026-03-24 22:46:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bada9f12-e66f-5e16-8270-62c2bb7ec9f5, skipping ID generation
2026-03-24 22:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with scrape type 1
2026-03-24 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5 sending to next pipeline
2026-03-24 22:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bada9f12-e66f-5e16-8270-62c2bb7ec9f5, identifier: 1981169
2026-03-24 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169
2026-03-24 22:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169
2026-03-24 22:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169 to the API
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bada9f12-e66f-5e16-8270-62c2bb7ec9f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 73579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bada9f12-e66f-5e16-8270-62c2bb7ec9f5/bada9f12-e66f-5e16-8270-62c2bb7ec9f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/176551032170435282657753dc32930e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.5 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.5 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981169%27 HTTP/1.1" 200 None
2026-03-24 22:46:25 [ayvens.be] INFO: Saving data for 1981169: {'created_time': 1774392385.973873, 'last_price_update_time': 1774392385.973882, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981169') HTTP/1.1" 204 0
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/2.jpg not downloaded yet
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/3.jpg not downloaded yet
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009870b90>
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/4.jpg saved to cache
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b0ed0>
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/5.jpg saved to cache
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4b50>
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/7.jpg saved to cache
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335a10>
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/6.jpg saved to cache
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/4.jpg not downloaded yet
2026-03-24 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/5.jpg not downloaded yet
2026-03-24 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/6.jpg not downloaded yet
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/7.jpg not downloaded yet
2026-03-24 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/8.jpg not downloaded yet
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/9.jpg not downloaded yet
2026-03-24 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/10.jpg not downloaded yet
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b8050>
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/10.jpg saved to cache
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bf190>
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/1.jpg saved to cache
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911dcd0>
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/8.jpg saved to cache
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:26 [ayvens.be] INFO: Found listing with ID: 1981173
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981173%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [ayvens.be] INFO: Scrape type for 1981173: 1
2026-03-24 22:46:26 [ayvens.be] INFO: Extracting data for car ID: 1981173
2026-03-24 22:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173
2026-03-24 22:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c25d1e4-4df3-555c-9e6e-3804b484e812 with scrape type 1
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/1.jpg not downloaded yet
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094499d0>
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F9361def82d0a4ec4bca4bf0c9eabb74f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/9.jpg saved to cache
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf74b177-c79e-5671-9cc0-4f2599309342
2026-03-24 22:46:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf74b177-c79e-5671-9cc0-4f2599309342, skipping ID generation
2026-03-24 22:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf74b177-c79e-5671-9cc0-4f2599309342 with scrape type 1
2026-03-24 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf74b177-c79e-5671-9cc0-4f2599309342 sending to next pipeline
2026-03-24 22:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bf74b177-c79e-5671-9cc0-4f2599309342, identifier: 1981170
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/2.jpg not downloaded yet
2026-03-24 22:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170
2026-03-24 22:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170
2026-03-24 22:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170 to the API
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bf74b177-c79e-5671-9cc0-4f2599309342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 58340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf74b177-c79e-5671-9cc0-4f2599309342/bf74b177-c79e-5671-9cc0-4f2599309342_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/9361def82d0a4ec4bca4bf0c9eabb74f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 35 TFSI (EU6d-TEMP)',
 'transmission': 'manual',
 'trim': '35 TFSI (EU6d-TEMP)',
 'vin': None,
 'year': 2020}
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981170%27 HTTP/1.1" 200 None
2026-03-24 22:46:27 [ayvens.be] INFO: Saving data for 1981170: {'created_time': 1774392387.442555, 'last_price_update_time': 1774392387.442566, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981170') HTTP/1.1" 204 0
2026-03-24 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/3.jpg not downloaded yet
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fb250>
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/3.jpg saved to cache
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b27d590>
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/2.jpg saved to cache
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed3490>
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/4.jpg saved to cache
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917e7d0>
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/5.jpg saved to cache
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/4.jpg not downloaded yet
2026-03-24 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/5.jpg not downloaded yet
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083121d0>
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/1.jpg saved to cache
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aa810>
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/2.jpg saved to cache
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/6.jpg not downloaded yet
2026-03-24 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/7.jpg not downloaded yet
2026-03-24 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/8.jpg not downloaded yet
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1bb250>
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/3.jpg saved to cache
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911ee90>
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/7.jpg saved to cache
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914f0d0>
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/8.jpg saved to cache
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/9.jpg not downloaded yet
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/10.jpg not downloaded yet
2026-03-24 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564ed0>
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/6.jpg saved to cache
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144190>
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/10.jpg saved to cache
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946dd10>
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F396dd54501494b428e263ef5b42078c5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/9.jpg saved to cache
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7
2026-03-24 22:46:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7, skipping ID generation
2026-03-24 22:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with scrape type 1
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 sending to next pipeline
2026-03-24 22:46:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7, identifier: 1981171
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1610>
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/4.jpg saved to cache
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:28 [ayvens.be] INFO: Found listing with ID: 1981174
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981174%27 HTTP/1.1" 200 None
2026-03-24 22:46:28 [ayvens.be] INFO: Scrape type for 1981174: 1
2026-03-24 22:46:28 [ayvens.be] INFO: Extracting data for car ID: 1981174
2026-03-24 22:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174
2026-03-24 22:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ac70e37-7aff-5307-9289-11c93460ae8a with scrape type 1
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/1.jpg not downloaded yet
2026-03-24 22:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171
2026-03-24 22:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171
2026-03-24 22:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171 to the API
2026-03-24 22:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '02b95496-d32c-5b55-a5e2-4b6f41ff1ee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'LEXUS',
 'model': 'NX 300h - 2017',
 'odometer': 153802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b95496-d32c-5b55-a5e2-4b6f41ff1ee7/02b95496-d32c-5b55-a5e2-4b6f41ff1ee7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/396dd54501494b428e263ef5b42078c5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LEXUS NX 300h - 2017 2.5i AWD Privilege Line E-CVT (EU6.2)',
 'transmission': 'automatic',
 'trim': '2.5i AWD Privilege Line E-CVT (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981171%27 HTTP/1.1" 200 None
2026-03-24 22:46:30 [ayvens.be] INFO: Saving data for 1981171: {'created_time': 1774392390.736211, 'last_price_update_time': 1774392390.736221, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981171') HTTP/1.1" 204 0
2026-03-24 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/2.jpg not downloaded yet
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/3.jpg not downloaded yet
2026-03-24 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343b50>
2026-03-24 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/10.jpg saved to cache
2026-03-24 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963ad10>
2026-03-24 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/9.jpg saved to cache
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008368d50>
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/5.jpg saved to cache
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c84d0>
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/7.jpg saved to cache
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009118e10>
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/6.jpg saved to cache
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/4.jpg not downloaded yet
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1190>
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/1.jpg saved to cache
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009012750>
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F189d165289274c0f8e7ea4d7a999986d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/8.jpg saved to cache
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0
2026-03-24 22:46:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0, skipping ID generation
2026-03-24 22:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with scrape type 1
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 sending to next pipeline
2026-03-24 22:46:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0, identifier: 1981172
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/5.jpg not downloaded yet
2026-03-24 22:46:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172
2026-03-24 22:46:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172
2026-03-24 22:46:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172 to the API
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 75657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0/af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/189d165289274c0f8e7ea4d7a999986d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S GT',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S GT',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981172%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [ayvens.be] INFO: Saving data for 1981172: {'created_time': 1774392392.063078, 'last_price_update_time': 1774392392.063089, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981172') HTTP/1.1" 204 0
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/6.jpg not downloaded yet
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/7.jpg not downloaded yet
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/8.jpg not downloaded yet
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/9.jpg not downloaded yet
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/10.jpg not downloaded yet
2026-03-24 22:46:32 [ayvens.be] INFO: Found listing with ID: 1981175
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981175%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [ayvens.be] INFO: Scrape type for 1981175: 1
2026-03-24 22:46:32 [ayvens.be] INFO: Extracting data for car ID: 1981175
2026-03-24 22:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175
2026-03-24 22:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 331bba43-88fa-5fd6-bc58-c262b85e16e4 with scrape type 1
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/1.jpg not downloaded yet
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/2.jpg not downloaded yet
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009565650>
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/5.jpg saved to cache
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343890>
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/3.jpg saved to cache
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b4650>
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/2.jpg saved to cache
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009612110>
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/4.jpg saved to cache
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442090>
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/6.jpg saved to cache
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/3.jpg not downloaded yet
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091437d0>
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/7.jpg saved to cache
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/4.jpg not downloaded yet
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094238d0>
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/8.jpg saved to cache
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009143c50>
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/9.jpg saved to cache
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/5.jpg not downloaded yet
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b27fcd0>
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/1.jpg saved to cache
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/6.jpg not downloaded yet
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/7.jpg not downloaded yet
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c7b50>
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/4.jpg saved to cache
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839a910>
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/3.jpg saved to cache
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009612c50>
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/6.jpg saved to cache
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938f790>
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/7.jpg saved to cache
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008314450>
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/2.jpg saved to cache
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641dd0>
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/5.jpg saved to cache
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/8.jpg not downloaded yet
2026-03-24 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/9.jpg not downloaded yet
2026-03-24 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/10.jpg not downloaded yet
2026-03-24 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:33 [ayvens.be] INFO: Found listing with ID: 1981176
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981176%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [ayvens.be] INFO: Scrape type for 1981176: 1
2026-03-24 22:46:33 [ayvens.be] INFO: Extracting data for car ID: 1981176
2026-03-24 22:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176
2026-03-24 22:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17214413-005d-58d6-88eb-3901260b89d0 with scrape type 1
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/1.jpg not downloaded yet
2026-03-24 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/2.jpg not downloaded yet
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/3.jpg not downloaded yet
2026-03-24 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/4.jpg not downloaded yet
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d4490>
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fd17f6661261049f5bd3c18792864b65f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/10.jpg saved to cache
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c25d1e4-4df3-555c-9e6e-3804b484e812
2026-03-24 22:46:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c25d1e4-4df3-555c-9e6e-3804b484e812, skipping ID generation
2026-03-24 22:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c25d1e4-4df3-555c-9e6e-3804b484e812 with scrape type 1
2026-03-24 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c25d1e4-4df3-555c-9e6e-3804b484e812 sending to next pipeline
2026-03-24 22:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c25d1e4-4df3-555c-9e6e-3804b484e812, identifier: 1981173
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093bad50>
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/9.jpg saved to cache
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173
2026-03-24 22:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173
2026-03-24 22:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173 to the API
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8c25d1e4-4df3-555c-9e6e-3804b484e812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ESPACE',
 'odometer': 72455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 872142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 829420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c25d1e4-4df3-555c-9e6e-3804b484e812/8c25d1e4-4df3-555c-9e6e-3804b484e812_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/d17f6661261049f5bd3c18792864b65f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ESPACE 2.0 BLUE DCI 190 EDC INITIALE PARIS',
 'transmission': 'automatic',
 'trim': '2.0 BLUE DCI 190 EDC INITIALE PARIS',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981173%27 HTTP/1.1" 200 None
2026-03-24 22:46:34 [ayvens.be] INFO: Saving data for 1981173: {'created_time': 1774392394.456033, 'last_price_update_time': 1774392394.456042, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981173') HTTP/1.1" 204 0
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/5.jpg not downloaded yet
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/6.jpg not downloaded yet
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372e90>
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/8.jpg saved to cache
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3890>
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fc749c9e840be41cd831ef30adbc13ac6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/10.jpg saved to cache
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ac70e37-7aff-5307-9289-11c93460ae8a
2026-03-24 22:46:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ac70e37-7aff-5307-9289-11c93460ae8a, skipping ID generation
2026-03-24 22:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ac70e37-7aff-5307-9289-11c93460ae8a with scrape type 1
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ac70e37-7aff-5307-9289-11c93460ae8a sending to next pipeline
2026-03-24 22:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ac70e37-7aff-5307-9289-11c93460ae8a, identifier: 1981174
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd890>
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/2.jpg saved to cache
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be510>
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/3.jpg saved to cache
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0310>
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/1.jpg saved to cache
2026-03-24 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a2990>
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/4.jpg saved to cache
2026-03-24 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/7.jpg not downloaded yet
2026-03-24 22:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174
2026-03-24 22:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174
2026-03-24 22:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174 to the API
2026-03-24 22:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '0ac70e37-7aff-5307-9289-11c93460ae8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 64706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ac70e37-7aff-5307-9289-11c93460ae8a/0ac70e37-7aff-5307-9289-11c93460ae8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/c749c9e840be41cd831ef30adbc13ac6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TFSI 110KW S TRONIC',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI 110KW S TRONIC',
 'vin': None,
 'year': 2020}
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981174%27 HTTP/1.1" 200 None
2026-03-24 22:46:36 [ayvens.be] INFO: Saving data for 1981174: {'created_time': 1774392396.048972, 'last_price_update_time': 1774392396.048984, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981174') HTTP/1.1" 204 0
2026-03-24 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/8.jpg not downloaded yet
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/9.jpg not downloaded yet
2026-03-24 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/10.jpg not downloaded yet
2026-03-24 22:46:36 [ayvens.be] INFO: Found listing with ID: 1981177
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981177%27 HTTP/1.1" 200 None
2026-03-24 22:46:36 [ayvens.be] INFO: Scrape type for 1981177: 1
2026-03-24 22:46:36 [ayvens.be] INFO: Extracting data for car ID: 1981177
2026-03-24 22:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177
2026-03-24 22:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2b3553c-9c84-5edb-8824-6696ed4b72ca with scrape type 1
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/1.jpg not downloaded yet
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/2.jpg not downloaded yet
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a29d0>
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/5.jpg saved to cache
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664e50>
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/6.jpg saved to cache
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7ad0>
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/7.jpg saved to cache
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/3.jpg not downloaded yet
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/4.jpg not downloaded yet
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121510>
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/8.jpg saved to cache
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336dd0>
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/10.jpg saved to cache
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009176050>
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/1.jpg saved to cache
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009012950>
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb78458a6f2b5406b93953b7d394aa46b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/9.jpg saved to cache
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 331bba43-88fa-5fd6-bc58-c262b85e16e4
2026-03-24 22:46:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 331bba43-88fa-5fd6-bc58-c262b85e16e4, skipping ID generation
2026-03-24 22:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 331bba43-88fa-5fd6-bc58-c262b85e16e4 with scrape type 1
2026-03-24 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 331bba43-88fa-5fd6-bc58-c262b85e16e4 sending to next pipeline
2026-03-24 22:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 331bba43-88fa-5fd6-bc58-c262b85e16e4, identifier: 1981175
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c7290>
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/2.jpg saved to cache
2026-03-24 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/5.jpg not downloaded yet
2026-03-24 22:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175
2026-03-24 22:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175
2026-03-24 22:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175 to the API
2026-03-24 22:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '331bba43-88fa-5fd6-bc58-c262b85e16e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON SPORTBACK',
 'odometer': 175527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_331bba43-88fa-5fd6-bc58-c262b85e16e4/331bba43-88fa-5fd6-bc58-c262b85e16e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b78458a6f2b5406b93953b7d394aa46b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON SPORTBACK BEV 95KWH 55 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 95KWH 55 QUATTRO S-LINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981175%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [ayvens.be] INFO: Saving data for 1981175: {'created_time': 1774392398.035845, 'last_price_update_time': 1774392398.035855, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981175') HTTP/1.1" 204 0
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/6.jpg not downloaded yet
2026-03-24 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/7.jpg not downloaded yet
2026-03-24 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/8.jpg not downloaded yet
2026-03-24 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/9.jpg not downloaded yet
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/10.jpg not downloaded yet
2026-03-24 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:38 [ayvens.be] INFO: Found listing with ID: 1981178
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981178%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [ayvens.be] INFO: Scrape type for 1981178: 1
2026-03-24 22:46:38 [ayvens.be] INFO: Extracting data for car ID: 1981178
2026-03-24 22:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178
2026-03-24 22:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4409a9-9ad5-5493-9e2c-50833909d336 with scrape type 1
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/1.jpg not downloaded yet
2026-03-24 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/2.jpg not downloaded yet
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422090>
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/3.jpg saved to cache
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945db50>
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/4.jpg saved to cache
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f190>
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/5.jpg saved to cache
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009566250>
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/6.jpg saved to cache
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a76d0>
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/7.jpg saved to cache
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/3.jpg not downloaded yet
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/4.jpg not downloaded yet
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ab850>
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/8.jpg saved to cache
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091acd50>
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/3.jpg saved to cache
2026-03-24 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900b790>
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/2.jpg saved to cache
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/5.jpg not downloaded yet
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/6.jpg not downloaded yet
2026-03-24 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/7.jpg not downloaded yet
2026-03-24 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/8.jpg not downloaded yet
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/9.jpg not downloaded yet
2026-03-24 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28450>
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/9.jpg saved to cache
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/10.jpg not downloaded yet
2026-03-24 22:46:39 [ayvens.be] INFO: Found listing with ID: 1981179
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981179%27 HTTP/1.1" 200 None
2026-03-24 22:46:39 [ayvens.be] INFO: Scrape type for 1981179: 1
2026-03-24 22:46:39 [ayvens.be] INFO: Extracting data for car ID: 1981179
2026-03-24 22:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179
2026-03-24 22:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56e558d-f409-5e26-a03f-a3ce35464bb6 with scrape type 1
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/1.jpg not downloaded yet
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/2.jpg not downloaded yet
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975b4d0>
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/1.jpg saved to cache
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964cc90>
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/7.jpg saved to cache
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091d7cd0>
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fc718e75e35c444a18eaf21a41f81a413%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/10.jpg saved to cache
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17214413-005d-58d6-88eb-3901260b89d0
2026-03-24 22:46:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17214413-005d-58d6-88eb-3901260b89d0, skipping ID generation
2026-03-24 22:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17214413-005d-58d6-88eb-3901260b89d0 with scrape type 1
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17214413-005d-58d6-88eb-3901260b89d0 sending to next pipeline
2026-03-24 22:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17214413-005d-58d6-88eb-3901260b89d0, identifier: 1981176
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd2d0>
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/4.jpg saved to cache
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945cb10>
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/6.jpg saved to cache
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2a2d0>
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/5.jpg saved to cache
2026-03-24 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae490>
2026-03-24 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/8.jpg saved to cache
2026-03-24 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176
2026-03-24 22:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176
2026-03-24 22:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176 to the API
2026-03-24 22:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '17214413-005d-58d6-88eb-3901260b89d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS7 CROSSBACK DIESEL',
 'odometer': 68115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17214413-005d-58d6-88eb-3901260b89d0/17214413-005d-58d6-88eb-3901260b89d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/c718e75e35c444a18eaf21a41f81a413/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS7 CROSSBACK DIESEL 1.5 BlueHDi Performance Line '
          '(EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Performance Line (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981176%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [ayvens.be] INFO: Saving data for 1981176: {'created_time': 1774392401.041871, 'last_price_update_time': 1774392401.04188, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981176') HTTP/1.1" 204 0
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/3.jpg not downloaded yet
2026-03-24 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/4.jpg not downloaded yet
2026-03-24 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/5.jpg not downloaded yet
2026-03-24 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/6.jpg not downloaded yet
2026-03-24 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/7.jpg not downloaded yet
2026-03-24 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/8.jpg not downloaded yet
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/9.jpg not downloaded yet
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338ad0>
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/2.jpg saved to cache
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4050>
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/1.jpg saved to cache
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009667a90>
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/3.jpg saved to cache
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/10.jpg not downloaded yet
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083385d0>
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/5.jpg saved to cache
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:41 [ayvens.be] INFO: Found listing with ID: 1981180
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981180%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [ayvens.be] INFO: Scrape type for 1981180: 1
2026-03-24 22:46:41 [ayvens.be] INFO: Extracting data for car ID: 1981180
2026-03-24 22:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180
2026-03-24 22:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with scrape type 1
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/1.jpg not downloaded yet
2026-03-24 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/2.jpg not downloaded yet
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf6890>
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/10.jpg saved to cache
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2850>
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F4f783422c01d441294e98df7534a79a7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/9.jpg saved to cache
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2b3553c-9c84-5edb-8824-6696ed4b72ca
2026-03-24 22:46:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2b3553c-9c84-5edb-8824-6696ed4b72ca, skipping ID generation
2026-03-24 22:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2b3553c-9c84-5edb-8824-6696ed4b72ca with scrape type 1
2026-03-24 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2b3553c-9c84-5edb-8824-6696ed4b72ca sending to next pipeline
2026-03-24 22:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2b3553c-9c84-5edb-8824-6696ed4b72ca, identifier: 1981177
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1bbd90>
2026-03-24 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/4.jpg saved to cache
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0d90>
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/6.jpg saved to cache
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177
2026-03-24 22:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177
2026-03-24 22:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177 to the API
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a2b3553c-9c84-5edb-8824-6696ed4b72ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 97573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2b3553c-9c84-5edb-8824-6696ed4b72ca/a2b3553c-9c84-5edb-8824-6696ed4b72ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/4f783422c01d441294e98df7534a79a7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.5 TDCI 88KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.5 TDCI 88KW TITANIUM X',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981177%27 HTTP/1.1" 200 None
2026-03-24 22:46:42 [ayvens.be] INFO: Saving data for 1981177: {'created_time': 1774392402.530933, 'last_price_update_time': 1774392402.530942, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981177') HTTP/1.1" 204 0
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/3.jpg not downloaded yet
2026-03-24 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/4.jpg not downloaded yet
2026-03-24 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00986a410>
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/7.jpg saved to cache
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/5.jpg not downloaded yet
2026-03-24 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/6.jpg not downloaded yet
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00986b750>
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/10.jpg saved to cache
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091867d0>
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/2.jpg saved to cache
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/7.jpg not downloaded yet
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bf590>
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/3.jpg saved to cache
2026-03-24 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009491650>
2026-03-24 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/1.jpg saved to cache
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/8.jpg not downloaded yet
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b490>
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/4.jpg saved to cache
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093966d0>
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/9.jpg saved to cache
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009684ed0>
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wj%252Fb55a8c9f1424452ea95b9af0dd744e8e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/8.jpg saved to cache
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a4409a9-9ad5-5493-9e2c-50833909d336
2026-03-24 22:46:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a4409a9-9ad5-5493-9e2c-50833909d336, skipping ID generation
2026-03-24 22:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4409a9-9ad5-5493-9e2c-50833909d336 with scrape type 1
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a4409a9-9ad5-5493-9e2c-50833909d336 sending to next pipeline
2026-03-24 22:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a4409a9-9ad5-5493-9e2c-50833909d336, identifier: 1981178
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeaf6d0>
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/5.jpg saved to cache
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/9.jpg not downloaded yet
2026-03-24 22:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178
2026-03-24 22:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178
2026-03-24 22:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178 to the API
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7a4409a9-9ad5-5493-9e2c-50833909d336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU SWB DSL -',
 'odometer': 91397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4409a9-9ad5-5493-9e2c-50833909d336/7a4409a9-9ad5-5493-9e2c-50833909d336_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wj/b55a8c9f1424452ea95b9af0dd744e8e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU SWB DSL - 2.0 TDi SCR BMT STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR BMT STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981178%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [ayvens.be] INFO: Saving data for 1981178: {'created_time': 1774392404.029869, 'last_price_update_time': 1774392404.029882, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981178') HTTP/1.1" 204 0
2026-03-24 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/10.jpg not downloaded yet
2026-03-24 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:44 [ayvens.be] INFO: Found listing with ID: 1981181
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981181%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [ayvens.be] INFO: Scrape type for 1981181: 1
2026-03-24 22:46:44 [ayvens.be] INFO: Extracting data for car ID: 1981181
2026-03-24 22:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181
2026-03-24 22:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc105ddb-de53-57db-9a21-f647522a6943 with scrape type 1
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/1.jpg not downloaded yet
2026-03-24 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/2.jpg not downloaded yet
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/3.jpg not downloaded yet
2026-03-24 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/4.jpg not downloaded yet
2026-03-24 22:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945ac50>
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/10.jpg saved to cache
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009143990>
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/9.jpg saved to cache
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/5.jpg not downloaded yet
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915e850>
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/7.jpg saved to cache
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/6.jpg not downloaded yet
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/7.jpg not downloaded yet
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382350>
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/8.jpg saved to cache
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aa190>
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc31b03bfb2654468add56bbdb328af57%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/6.jpg saved to cache
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c56e558d-f409-5e26-a03f-a3ce35464bb6
2026-03-24 22:46:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c56e558d-f409-5e26-a03f-a3ce35464bb6, skipping ID generation
2026-03-24 22:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56e558d-f409-5e26-a03f-a3ce35464bb6 with scrape type 1
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c56e558d-f409-5e26-a03f-a3ce35464bb6 sending to next pipeline
2026-03-24 22:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c56e558d-f409-5e26-a03f-a3ce35464bb6, identifier: 1981179
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1dec50>
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/3.jpg saved to cache
2026-03-24 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd410>
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/2.jpg saved to cache
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179
2026-03-24 22:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179
2026-03-24 22:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179 to the API
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c56e558d-f409-5e26-a03f-a3ce35464bb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 80002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c56e558d-f409-5e26-a03f-a3ce35464bb6/c56e558d-f409-5e26-a03f-a3ce35464bb6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c31b03bfb2654468add56bbdb328af57/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981179%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [ayvens.be] INFO: Saving data for 1981179: {'created_time': 1774392405.447877, 'last_price_update_time': 1774392405.447887, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981179') HTTP/1.1" 204 0
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/8.jpg not downloaded yet
2026-03-24 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/9.jpg not downloaded yet
2026-03-24 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/10.jpg not downloaded yet
2026-03-24 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:45 [ayvens.be] INFO: Found listing with ID: 1981182
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981182%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [ayvens.be] INFO: Scrape type for 1981182: 1
2026-03-24 22:46:45 [ayvens.be] INFO: Extracting data for car ID: 1981182
2026-03-24 22:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182
2026-03-24 22:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aceaaa9-c92a-515d-ba6b-e81b502da630 with scrape type 1
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/1.jpg not downloaded yet
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/2.jpg not downloaded yet
2026-03-24 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/3.jpg not downloaded yet
2026-03-24 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/4.jpg not downloaded yet
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009143610>
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/6.jpg saved to cache
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/5.jpg not downloaded yet
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d5fd0>
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/4.jpg saved to cache
2026-03-24 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bcd50>
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/7.jpg saved to cache
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938ff50>
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/5.jpg saved to cache
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/6.jpg not downloaded yet
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/7.jpg not downloaded yet
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008380050>
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/8.jpg saved to cache
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008311b50>
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/10.jpg saved to cache
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372750>
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/9.jpg saved to cache
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407490>
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xa%252F8e19d7787dab421ea05d2b46519b9d57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/1.jpg saved to cache
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3
2026-03-24 22:46:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3, skipping ID generation
2026-03-24 22:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with scrape type 1
2026-03-24 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 sending to next pipeline
2026-03-24 22:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3, identifier: 1981180
2026-03-24 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180
2026-03-24 22:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180
2026-03-24 22:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180 to the API
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '63b06c4f-b3e4-52db-b6d0-71fd8b18aee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB DIESEL - 2019',
 'odometer': 162489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63b06c4f-b3e4-52db-b6d0-71fd8b18aee3/63b06c4f-b3e4-52db-b6d0-71fd8b18aee3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xa/8e19d7787dab421ea05d2b46519b9d57/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB DIESEL - 2019 1.6 CR TDi Style DSG',
 'transmission': 'automatic',
 'trim': '1.6 CR TDi Style DSG',
 'vin': None,
 'year': 2019}
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981180%27 HTTP/1.1" 200 None
2026-03-24 22:46:46 [ayvens.be] INFO: Saving data for 1981180: {'created_time': 1774392406.994496, 'last_price_update_time': 1774392406.994505, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981180') HTTP/1.1" 204 0
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/8.jpg not downloaded yet
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/9.jpg not downloaded yet
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a2450>
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/1.jpg saved to cache
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c90d0>
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/2.jpg saved to cache
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945c5d0>
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/3.jpg saved to cache
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/10.jpg not downloaded yet
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [ayvens.be] INFO: Found listing with ID: 1981183
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981183%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [ayvens.be] INFO: Scrape type for 1981183: 1
2026-03-24 22:46:47 [ayvens.be] INFO: Extracting data for car ID: 1981183
2026-03-24 22:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183
2026-03-24 22:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b6a74b-2362-54af-9350-d76aac1792fd with scrape type 1
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/1.jpg not downloaded yet
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564650>
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/5.jpg saved to cache
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/2.jpg not downloaded yet
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/3.jpg not downloaded yet
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf5710>
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/7.jpg saved to cache
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b6010>
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/4.jpg saved to cache
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967c910>
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/8.jpg saved to cache
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945b110>
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/6.jpg saved to cache
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/4.jpg not downloaded yet
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/5.jpg not downloaded yet
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/6.jpg not downloaded yet
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/7.jpg not downloaded yet
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/8.jpg not downloaded yet
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/9.jpg not downloaded yet
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/10.jpg not downloaded yet
2026-03-24 22:46:47 [ayvens.be] INFO: Found listing with ID: 1981184
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981184%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [ayvens.be] INFO: Scrape type for 1981184: 1
2026-03-24 22:46:47 [ayvens.be] INFO: Extracting data for car ID: 1981184
2026-03-24 22:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184
2026-03-24 22:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with scrape type 1
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/1.jpg not downloaded yet
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f1190>
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/9.jpg saved to cache
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839add0>
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5c7f73073c404359a5c18abb1eb8443c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/10.jpg saved to cache
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc105ddb-de53-57db-9a21-f647522a6943
2026-03-24 22:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc105ddb-de53-57db-9a21-f647522a6943, skipping ID generation
2026-03-24 22:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc105ddb-de53-57db-9a21-f647522a6943 with scrape type 1
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc105ddb-de53-57db-9a21-f647522a6943 sending to next pipeline
2026-03-24 22:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc105ddb-de53-57db-9a21-f647522a6943, identifier: 1981181
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/2.jpg not downloaded yet
2026-03-24 22:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181
2026-03-24 22:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181
2026-03-24 22:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181 to the API
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bc105ddb-de53-57db-9a21-f647522a6943',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 28223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc105ddb-de53-57db-9a21-f647522a6943/bc105ddb-de53-57db-9a21-f647522a6943_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5c7f73073c404359a5c18abb1eb8443c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 180 ESSENTIAL LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 B 180 ESSENTIAL LINE DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981181%27 HTTP/1.1" 200 None
2026-03-24 22:46:48 [ayvens.be] INFO: Saving data for 1981181: {'created_time': 1774392408.617494, 'last_price_update_time': 1774392408.617503, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981181') HTTP/1.1" 204 0
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121d90>
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/1.jpg saved to cache
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/3.jpg not downloaded yet
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/4.jpg not downloaded yet
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009010a90>
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/2.jpg saved to cache
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915ec90>
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/4.jpg saved to cache
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830b4d0>
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/5.jpg saved to cache
2026-03-24 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946f110>
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/3.jpg saved to cache
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008337150>
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/6.jpg saved to cache
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/5.jpg not downloaded yet
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/6.jpg not downloaded yet
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/7.jpg not downloaded yet
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/8.jpg not downloaded yet
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/9.jpg not downloaded yet
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/10.jpg not downloaded yet
2026-03-24 22:46:49 [ayvens.be] INFO: Found listing with ID: 1981185
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981185%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [ayvens.be] INFO: Scrape type for 1981185: 1
2026-03-24 22:46:49 [ayvens.be] INFO: Extracting data for car ID: 1981185
2026-03-24 22:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185
2026-03-24 22:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882573fb-1930-56f8-ac29-e5d6c092958b with scrape type 1
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/1.jpg not downloaded yet
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/2.jpg not downloaded yet
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0176a1690>
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/7.jpg saved to cache
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/3.jpg not downloaded yet
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0cd0>
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/2.jpg saved to cache
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b57d0>
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/1.jpg saved to cache
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00986a250>
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/10.jpg saved to cache
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175790>
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/9.jpg saved to cache
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009421810>
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/3.jpg saved to cache
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3590>
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/4.jpg saved to cache
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/4.jpg not downloaded yet
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/5.jpg not downloaded yet
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008314350>
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F5bf60af63d28493c8755a2c51dccb4bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/8.jpg saved to cache
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7aceaaa9-c92a-515d-ba6b-e81b502da630
2026-03-24 22:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7aceaaa9-c92a-515d-ba6b-e81b502da630, skipping ID generation
2026-03-24 22:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aceaaa9-c92a-515d-ba6b-e81b502da630 with scrape type 1
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7aceaaa9-c92a-515d-ba6b-e81b502da630 sending to next pipeline
2026-03-24 22:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7aceaaa9-c92a-515d-ba6b-e81b502da630, identifier: 1981182
2026-03-24 22:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182
2026-03-24 22:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182
2026-03-24 22:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182 to the API
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7aceaaa9-c92a-515d-ba6b-e81b502da630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 124706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aceaaa9-c92a-515d-ba6b-e81b502da630/7aceaaa9-c92a-515d-ba6b-e81b502da630_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/5bf60af63d28493c8755a2c51dccb4bf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TDI 120KW S TR ADV BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR ADV BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981182%27 HTTP/1.1" 200 None
2026-03-24 22:46:50 [ayvens.be] INFO: Saving data for 1981182: {'created_time': 1774392410.621697, 'last_price_update_time': 1774392410.621708, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981182') HTTP/1.1" 204 0
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/6.jpg not downloaded yet
2026-03-24 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/7.jpg not downloaded yet
2026-03-24 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083172d0>
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/2.jpg saved to cache
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0110>
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/1.jpg saved to cache
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/8.jpg not downloaded yet
2026-03-24 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/9.jpg not downloaded yet
2026-03-24 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/10.jpg not downloaded yet
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493a10>
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/5.jpg saved to cache
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:50 [ayvens.be] INFO: Found listing with ID: 1981186
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981186%27 HTTP/1.1" 200 None
2026-03-24 22:46:50 [ayvens.be] INFO: Scrape type for 1981186: 1
2026-03-24 22:46:50 [ayvens.be] INFO: Extracting data for car ID: 1981186
2026-03-24 22:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186
2026-03-24 22:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cfc13c-7357-50e4-9a81-496fc7f2697f with scrape type 1
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/1.jpg not downloaded yet
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b1650>
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/7.jpg saved to cache
2026-03-24 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/2.jpg not downloaded yet
2026-03-24 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094912d0>
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/6.jpg saved to cache
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394d50>
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/10.jpg saved to cache
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911e3d0>
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/5.jpg saved to cache
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d6990>
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/6.jpg saved to cache
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967e1d0>
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/8.jpg saved to cache
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916c710>
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Fc9a3203bc3b44470924743fb24205d72%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/9.jpg saved to cache
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59b6a74b-2362-54af-9350-d76aac1792fd
2026-03-24 22:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59b6a74b-2362-54af-9350-d76aac1792fd, skipping ID generation
2026-03-24 22:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b6a74b-2362-54af-9350-d76aac1792fd with scrape type 1
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59b6a74b-2362-54af-9350-d76aac1792fd sending to next pipeline
2026-03-24 22:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59b6a74b-2362-54af-9350-d76aac1792fd, identifier: 1981183
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/3.jpg not downloaded yet
2026-03-24 22:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183
2026-03-24 22:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183
2026-03-24 22:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183 to the API
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '59b6a74b-2362-54af-9350-d76aac1792fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500 - 2015',
 'odometer': 76076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59b6a74b-2362-54af-9350-d76aac1792fd/59b6a74b-2362-54af-9350-d76aac1792fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/c9a3203bc3b44470924743fb24205d72/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 - 2015 1.0i MHEV Lounge',
 'transmission': 'manual',
 'trim': '1.0i MHEV Lounge',
 'vin': None,
 'year': 2020}
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981183%27 HTTP/1.1" 200 None
2026-03-24 22:46:51 [ayvens.be] INFO: Saving data for 1981183: {'created_time': 1774392411.942653, 'last_price_update_time': 1774392411.942664, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981183') HTTP/1.1" 204 0
2026-03-24 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/4.jpg not downloaded yet
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945b990>
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/3.jpg saved to cache
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b9d10>
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/4.jpg saved to cache
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/5.jpg not downloaded yet
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/6.jpg not downloaded yet
2026-03-24 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed0650>
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/9.jpg saved to cache
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/7.jpg not downloaded yet
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/8.jpg not downloaded yet
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/9.jpg not downloaded yet
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c790>
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/3.jpg saved to cache
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bd350>
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/2.jpg saved to cache
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091919d0>
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/1.jpg saved to cache
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ab690>
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/4.jpg saved to cache
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a9cd0>
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/10.jpg saved to cache
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/10.jpg not downloaded yet
2026-03-24 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:53 [ayvens.be] INFO: Found listing with ID: 1981187
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981187%27 HTTP/1.1" 200 None
2026-03-24 22:46:53 [ayvens.be] INFO: Scrape type for 1981187: 1
2026-03-24 22:46:53 [ayvens.be] INFO: Extracting data for car ID: 1981187
2026-03-24 22:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187
2026-03-24 22:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72a7c77-b267-5998-b7cd-188d4962645c with scrape type 1
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/1.jpg not downloaded yet
2026-03-24 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009667710>
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/5.jpg saved to cache
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131490>
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/6.jpg saved to cache
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/2.jpg not downloaded yet
2026-03-24 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/3.jpg not downloaded yet
2026-03-24 22:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/4.jpg not downloaded yet
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b53d0>
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/7.jpg saved to cache
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d290>
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xt%252F5559902dd7324fb5a12e7de5084d2c84%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/8.jpg saved to cache
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e
2026-03-24 22:46:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e, skipping ID generation
2026-03-24 22:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with scrape type 1
2026-03-24 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e sending to next pipeline
2026-03-24 22:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e, identifier: 1981184
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ab7d0>
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/8.jpg saved to cache
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184
2026-03-24 22:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184
2026-03-24 22:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184 to the API
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 DIESEL - 2017',
 'odometer': 87500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e/67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xt/5559902dd7324fb5a12e7de5084d2c84/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 DIESEL - 2017 1.5 BlueHDi Active (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981184%27 HTTP/1.1" 200 None
2026-03-24 22:46:54 [ayvens.be] INFO: Saving data for 1981184: {'created_time': 1774392414.479355, 'last_price_update_time': 1774392414.479364, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981184') HTTP/1.1" 204 0
2026-03-24 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/5.jpg not downloaded yet
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/6.jpg not downloaded yet
2026-03-24 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091876d0>
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/9.jpg saved to cache
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f750>
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/1.jpg saved to cache
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440110>
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/2.jpg saved to cache
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce410>
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/10.jpg saved to cache
2026-03-24 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083baf90>
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fc45b18bc406a4f938950d5b6a005e405%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/7.jpg saved to cache
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 882573fb-1930-56f8-ac29-e5d6c092958b
2026-03-24 22:46:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 882573fb-1930-56f8-ac29-e5d6c092958b, skipping ID generation
2026-03-24 22:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882573fb-1930-56f8-ac29-e5d6c092958b with scrape type 1
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 882573fb-1930-56f8-ac29-e5d6c092958b sending to next pipeline
2026-03-24 22:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 882573fb-1930-56f8-ac29-e5d6c092958b, identifier: 1981185
2026-03-24 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/7.jpg not downloaded yet
2026-03-24 22:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185
2026-03-24 22:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185
2026-03-24 22:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185 to the API
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '882573fb-1930-56f8-ac29-e5d6c092958b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 79199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_882573fb-1930-56f8-ac29-e5d6c092958b/882573fb-1930-56f8-ac29-e5d6c092958b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/c45b18bc406a4f938950d5b6a005e405/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216I ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216I ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981185%27 HTTP/1.1" 200 None
2026-03-24 22:46:55 [ayvens.be] INFO: Saving data for 1981185: {'created_time': 1774392415.44941, 'last_price_update_time': 1774392415.449419, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981185') HTTP/1.1" 204 0
2026-03-24 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/8.jpg not downloaded yet
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838e410>
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/3.jpg saved to cache
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009177990>
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/4.jpg saved to cache
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359e50>
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/7.jpg saved to cache
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083254d0>
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/6.jpg saved to cache
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b510>
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/5.jpg saved to cache
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28710>
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/10.jpg saved to cache
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/9.jpg not downloaded yet
2026-03-24 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/10.jpg not downloaded yet
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b4e10>
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/8.jpg saved to cache
2026-03-24 22:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b2ed0>
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fbdf5f1dc953846eeac256f41262514d5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/9.jpg saved to cache
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8cfc13c-7357-50e4-9a81-496fc7f2697f
2026-03-24 22:46:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8cfc13c-7357-50e4-9a81-496fc7f2697f, skipping ID generation
2026-03-24 22:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cfc13c-7357-50e4-9a81-496fc7f2697f with scrape type 1
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8cfc13c-7357-50e4-9a81-496fc7f2697f sending to next pipeline
2026-03-24 22:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c8cfc13c-7357-50e4-9a81-496fc7f2697f, identifier: 1981186
2026-03-24 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186
2026-03-24 22:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186
2026-03-24 22:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186 to the API
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c8cfc13c-7357-50e4-9a81-496fc7f2697f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 78402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cfc13c-7357-50e4-9a81-496fc7f2697f/c8cfc13c-7357-50e4-9a81-496fc7f2697f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/bdf5f1dc953846eeac256f41262514d5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 2.0 TDI 35 S TRONIC BUSINESS ED SPORT',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 S TRONIC BUSINESS ED SPORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981186%27 HTTP/1.1" 200 None
2026-03-24 22:46:56 [ayvens.be] INFO: Saving data for 1981186: {'created_time': 1774392416.496681, 'last_price_update_time': 1774392416.49669, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981186') HTTP/1.1" 204 0
2026-03-24 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:56 [ayvens.be] INFO: Found listing with ID: 1981188
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981188%27 HTTP/1.1" 200 None
2026-03-24 22:46:56 [ayvens.be] INFO: Scrape type for 1981188: 1
2026-03-24 22:46:56 [ayvens.be] INFO: Extracting data for car ID: 1981188
2026-03-24 22:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188
2026-03-24 22:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a002bfd-a915-531e-b05e-d40568f19197 with scrape type 1
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/1.jpg not downloaded yet
2026-03-24 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed3e50>
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/1.jpg saved to cache
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ba550>
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/2.jpg saved to cache
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/2.jpg not downloaded yet
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091117d0>
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/3.jpg saved to cache
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/3.jpg not downloaded yet
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083176d0>
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/4.jpg saved to cache
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345750>
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/6.jpg saved to cache
2026-03-24 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009011990>
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/5.jpg saved to cache
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/4.jpg not downloaded yet
2026-03-24 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345010>
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/8.jpg saved to cache
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/5.jpg not downloaded yet
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/6.jpg not downloaded yet
2026-03-24 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009423d10>
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/7.jpg saved to cache
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/7.jpg not downloaded yet
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b1410>
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/9.jpg saved to cache
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/8.jpg not downloaded yet
2026-03-24 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/9.jpg not downloaded yet
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c0390>
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4fa1b69503a447fab1d87d7c11d0668a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/10.jpg saved to cache
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a72a7c77-b267-5998-b7cd-188d4962645c
2026-03-24 22:46:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a72a7c77-b267-5998-b7cd-188d4962645c, skipping ID generation
2026-03-24 22:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72a7c77-b267-5998-b7cd-188d4962645c with scrape type 1
2026-03-24 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a72a7c77-b267-5998-b7cd-188d4962645c sending to next pipeline
2026-03-24 22:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a72a7c77-b267-5998-b7cd-188d4962645c, identifier: 1981187
2026-03-24 22:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187
2026-03-24 22:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187
2026-03-24 22:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187 to the API
2026-03-24 22:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a72a7c77-b267-5998-b7cd-188d4962645c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 109261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72a7c77-b267-5998-b7cd-188d4962645c/a72a7c77-b267-5998-b7cd-188d4962645c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4fa1b69503a447fab1d87d7c11d0668a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981187%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [ayvens.be] INFO: Saving data for 1981187: {'created_time': 1774392418.711801, 'last_price_update_time': 1774392418.711811, 'auction_closing_time': 1774855800.0}
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981187') HTTP/1.1" 204 0
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/10.jpg not downloaded yet
2026-03-24 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913ed90>
2026-03-24 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/1.jpg saved to cache
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:46:58 [ayvens.be] INFO: Found listing with ID: 1981189
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981189%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [ayvens.be] INFO: Scrape type for 1981189: 1
2026-03-24 22:46:58 [ayvens.be] INFO: Extracting data for car ID: 1981189
2026-03-24 22:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189
2026-03-24 22:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16158bbe-f025-5494-907d-ec6a1d3f8c66 with scrape type 1
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/1.jpg not downloaded yet
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/2.jpg not downloaded yet
2026-03-24 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/3.jpg not downloaded yet
2026-03-24 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/4.jpg not downloaded yet
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/5.jpg not downloaded yet
2026-03-24 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/6.jpg not downloaded yet
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/7.jpg not downloaded yet
2026-03-24 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/8.jpg not downloaded yet
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/9.jpg not downloaded yet
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c0d0>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/3.jpg saved to cache
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3a10>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/2.jpg saved to cache
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b39d0>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/4.jpg saved to cache
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/10.jpg not downloaded yet
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bb0d0>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/5.jpg saved to cache
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613e50>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/7.jpg saved to cache
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:46:59 [ayvens.be] INFO: Found listing with ID: 1981190
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981190%27 HTTP/1.1" 200 None
2026-03-24 22:46:59 [ayvens.be] INFO: Scrape type for 1981190: 1
2026-03-24 22:46:59 [ayvens.be] INFO: Extracting data for car ID: 1981190
2026-03-24 22:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190
2026-03-24 22:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with scrape type 1
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/1.jpg not downloaded yet
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bb210>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/6.jpg saved to cache
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c750>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/8.jpg saved to cache
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bb950>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/2.jpg saved to cache
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/2.jpg not downloaded yet
2026-03-24 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/3.jpg not downloaded yet
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/4.jpg not downloaded yet
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/5.jpg not downloaded yet
2026-03-24 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914ccd0>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/4.jpg saved to cache
2026-03-24 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009466b50>
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/3.jpg saved to cache
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b3890>
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/1.jpg saved to cache
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/6.jpg not downloaded yet
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/7.jpg not downloaded yet
2026-03-24 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/8.jpg not downloaded yet
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083397d0>
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/10.jpg saved to cache
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009642ad0>
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/5.jpg saved to cache
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a85d0>
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/6.jpg saved to cache
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e790>
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252F0582b6b9c33d4810985d11de75e2d793%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/9.jpg saved to cache
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a002bfd-a915-531e-b05e-d40568f19197
2026-03-24 22:47:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a002bfd-a915-531e-b05e-d40568f19197, skipping ID generation
2026-03-24 22:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a002bfd-a915-531e-b05e-d40568f19197 with scrape type 1
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a002bfd-a915-531e-b05e-d40568f19197 sending to next pipeline
2026-03-24 22:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a002bfd-a915-531e-b05e-d40568f19197, identifier: 1981188
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1a8c90>
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/9.jpg saved to cache
2026-03-24 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188
2026-03-24 22:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188
2026-03-24 22:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188 to the API
2026-03-24 22:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9a002bfd-a915-531e-b05e-d40568f19197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': 23776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 889060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a002bfd-a915-531e-b05e-d40568f19197/9a002bfd-a915-531e-b05e-d40568f19197_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/0582b6b9c33d4810985d11de75e2d793/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA FABIA 1.0 TSI 85KW DSG CORPORATE',
 'transmission': 'automatic',
 'trim': '1.0 TSI 85KW DSG CORPORATE',
 'vin': None,
 'year': 2024}
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981188%27 HTTP/1.1" 200 None
2026-03-24 22:47:01 [ayvens.be] INFO: Saving data for 1981188: {'created_time': 1774392421.164786, 'last_price_update_time': 1774392421.164796, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981188') HTTP/1.1" 204 0
2026-03-24 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/9.jpg not downloaded yet
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945c390>
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/2.jpg saved to cache
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed1b90>
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/1.jpg saved to cache
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/10.jpg not downloaded yet
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019010>
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/7.jpg saved to cache
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6210>
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/8.jpg saved to cache
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d7510>
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/3.jpg saved to cache
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:01 [ayvens.be] INFO: Found listing with ID: 1981191
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981191%27 HTTP/1.1" 200 None
2026-03-24 22:47:01 [ayvens.be] INFO: Scrape type for 1981191: 1
2026-03-24 22:47:01 [ayvens.be] INFO: Extracting data for car ID: 1981191
2026-03-24 22:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191
2026-03-24 22:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe091a10-bfdc-5d3f-8236-47195332ac34 with scrape type 1
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/1.jpg not downloaded yet
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b9090>
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F190bfffb02fd4a84bfccb1bde9ae1276%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/10.jpg saved to cache
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16158bbe-f025-5494-907d-ec6a1d3f8c66
2026-03-24 22:47:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16158bbe-f025-5494-907d-ec6a1d3f8c66, skipping ID generation
2026-03-24 22:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16158bbe-f025-5494-907d-ec6a1d3f8c66 with scrape type 1
2026-03-24 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16158bbe-f025-5494-907d-ec6a1d3f8c66 sending to next pipeline
2026-03-24 22:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 16158bbe-f025-5494-907d-ec6a1d3f8c66, identifier: 1981189
2026-03-24 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189
2026-03-24 22:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189
2026-03-24 22:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189 to the API
2026-03-24 22:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '16158bbe-f025-5494-907d-ec6a1d3f8c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 72213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16158bbe-f025-5494-907d-ec6a1d3f8c66/16158bbe-f025-5494-907d-ec6a1d3f8c66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/190bfffb02fd4a84bfccb1bde9ae1276/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981189%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [ayvens.be] INFO: Saving data for 1981189: {'created_time': 1774392422.361461, 'last_price_update_time': 1774392422.36147, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981189') HTTP/1.1" 204 0
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/2.jpg not downloaded yet
2026-03-24 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b2ca2d0>
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/4.jpg saved to cache
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912a790>
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/5.jpg saved to cache
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/3.jpg not downloaded yet
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b61f10>
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/6.jpg saved to cache
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/4.jpg not downloaded yet
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009684d50>
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/7.jpg saved to cache
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/5.jpg not downloaded yet
2026-03-24 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/6.jpg not downloaded yet
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/7.jpg not downloaded yet
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/8.jpg not downloaded yet
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/9.jpg not downloaded yet
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/10.jpg not downloaded yet
2026-03-24 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:02 [ayvens.be] INFO: Found listing with ID: 1981192
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981192%27 HTTP/1.1" 200 None
2026-03-24 22:47:02 [ayvens.be] INFO: Scrape type for 1981192: 1
2026-03-24 22:47:02 [ayvens.be] INFO: Extracting data for car ID: 1981192
2026-03-24 22:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192
2026-03-24 22:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00dbba5e-e47b-5613-9827-74f622da8956 with scrape type 1
2026-03-24 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/1.jpg not downloaded yet
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008339190>
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/8.jpg saved to cache
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119110>
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/9.jpg saved to cache
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/2.jpg not downloaded yet
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009177750>
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F6bb5155c87b7457599cbd7a7470a6a33%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/10.jpg saved to cache
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d
2026-03-24 22:47:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d, skipping ID generation
2026-03-24 22:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with scrape type 1
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d sending to next pipeline
2026-03-24 22:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d, identifier: 1981190
2026-03-24 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190
2026-03-24 22:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190
2026-03-24 22:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190 to the API
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '7d90bae9-76bb-55ed-8860-c28c42a7ee2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 57971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d90bae9-76bb-55ed-8860-c28c42a7ee2d/7d90bae9-76bb-55ed-8860-c28c42a7ee2d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/6bb5155c87b7457599cbd7a7470a6a33/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981190%27 HTTP/1.1" 200 None
2026-03-24 22:47:03 [ayvens.be] INFO: Saving data for 1981190: {'created_time': 1774392423.886259, 'last_price_update_time': 1774392423.88627, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981190') HTTP/1.1" 204 0
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/3.jpg not downloaded yet
2026-03-24 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009191bd0>
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/2.jpg saved to cache
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/4.jpg not downloaded yet
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2090>
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/1.jpg saved to cache
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/5.jpg not downloaded yet
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/6.jpg not downloaded yet
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d150>
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/3.jpg saved to cache
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/7.jpg not downloaded yet
2026-03-24 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/8.jpg not downloaded yet
2026-03-24 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/9.jpg not downloaded yet
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/10.jpg not downloaded yet
2026-03-24 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:04 [ayvens.be] INFO: Found listing with ID: 1981193
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981193%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [ayvens.be] INFO: Scrape type for 1981193: 1
2026-03-24 22:47:04 [ayvens.be] INFO: Extracting data for car ID: 1981193
2026-03-24 22:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193
2026-03-24 22:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57c50d68-de83-5965-b7b6-58c456a320f5 with scrape type 1
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/1.jpg not downloaded yet
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/2.jpg not downloaded yet
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131a90>
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/5.jpg saved to cache
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317ad0>
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/7.jpg saved to cache
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009868c10>
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/4.jpg saved to cache
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008314590>
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/6.jpg saved to cache
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/3.jpg not downloaded yet
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/4.jpg not downloaded yet
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8cd0>
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/8.jpg saved to cache
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f490>
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/9.jpg saved to cache
2026-03-24 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b6810>
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/1.jpg saved to cache
2026-03-24 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610310>
2026-03-24 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fp%252F52fbd892fae94b148e42b264dc9eed77%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/10.jpg saved to cache
2026-03-24 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe091a10-bfdc-5d3f-8236-47195332ac34
2026-03-24 22:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe091a10-bfdc-5d3f-8236-47195332ac34, skipping ID generation
2026-03-24 22:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe091a10-bfdc-5d3f-8236-47195332ac34 with scrape type 1
2026-03-24 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe091a10-bfdc-5d3f-8236-47195332ac34 sending to next pipeline
2026-03-24 22:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe091a10-bfdc-5d3f-8236-47195332ac34, identifier: 1981191
2026-03-24 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191
2026-03-24 22:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191
2026-03-24 22:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191 to the API
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fe091a10-bfdc-5d3f-8236-47195332ac34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 32910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe091a10-bfdc-5d3f-8236-47195332ac34/fe091a10-bfdc-5d3f-8236-47195332ac34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fp/52fbd892fae94b148e42b264dc9eed77/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.0 T-GDI MHEV PULSE DCT",
 'transmission': 'automatic',
 'trim': '1.0 T-GDI MHEV PULSE DCT',
 'vin': None,
 'year': 2024}
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981191%27 HTTP/1.1" 200 None
2026-03-24 22:47:05 [ayvens.be] INFO: Saving data for 1981191: {'created_time': 1774392425.882338, 'last_price_update_time': 1774392425.882351, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981191') HTTP/1.1" 204 0
2026-03-24 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/5.jpg not downloaded yet
2026-03-24 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/6.jpg not downloaded yet
2026-03-24 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093db3d0>
2026-03-24 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/4.jpg saved to cache
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019010>
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/2.jpg saved to cache
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/7.jpg not downloaded yet
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/8.jpg not downloaded yet
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/9.jpg not downloaded yet
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121e90>
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/5.jpg saved to cache
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cf250>
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/3.jpg saved to cache
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/10.jpg not downloaded yet
2026-03-24 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:06 [ayvens.be] INFO: Found listing with ID: 1981194
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981194%27 HTTP/1.1" 200 None
2026-03-24 22:47:06 [ayvens.be] INFO: Scrape type for 1981194: 1
2026-03-24 22:47:06 [ayvens.be] INFO: Extracting data for car ID: 1981194
2026-03-24 22:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194
2026-03-24 22:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with scrape type 1
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/1.jpg not downloaded yet
2026-03-24 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128110>
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/6.jpg saved to cache
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009120c50>
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/7.jpg saved to cache
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/2.jpg not downloaded yet
2026-03-24 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:06 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 1 pages/min), scraped 57 items (at 33 items/min)
2026-03-24 22:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/3.jpg not downloaded yet
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1490>
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/10.jpg saved to cache
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422a50>
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/1.jpg saved to cache
2026-03-24 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/4.jpg not downloaded yet
2026-03-24 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/5.jpg not downloaded yet
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009566c10>
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/3.jpg saved to cache
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962da10>
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/2.jpg saved to cache
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912bc10>
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/8.jpg saved to cache
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/6.jpg not downloaded yet
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/7.jpg not downloaded yet
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfe710>
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Faec0c62e55ef4f6ca7b0de36cad81ad8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/9.jpg saved to cache
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00dbba5e-e47b-5613-9827-74f622da8956
2026-03-24 22:47:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00dbba5e-e47b-5613-9827-74f622da8956, skipping ID generation
2026-03-24 22:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00dbba5e-e47b-5613-9827-74f622da8956 with scrape type 1
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00dbba5e-e47b-5613-9827-74f622da8956 sending to next pipeline
2026-03-24 22:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00dbba5e-e47b-5613-9827-74f622da8956, identifier: 1981192
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1510>
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/4.jpg saved to cache
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872a10>
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/5.jpg saved to cache
2026-03-24 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192
2026-03-24 22:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192
2026-03-24 22:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192 to the API
2026-03-24 22:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '00dbba5e-e47b-5613-9827-74f622da8956',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'ABARTH',
 'model': '500',
 'odometer': 54253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 901300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00dbba5e-e47b-5613-9827-74f622da8956/00dbba5e-e47b-5613-9827-74f622da8956_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/aec0c62e55ef4f6ca7b0de36cad81ad8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'ABARTH 500 1.4 T-JET 595',
 'transmission': 'manual',
 'trim': '1.4 T-JET 595',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981192%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [ayvens.be] INFO: Saving data for 1981192: {'created_time': 1774392428.370271, 'last_price_update_time': 1774392428.370282, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981192') HTTP/1.1" 204 0
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/8.jpg not downloaded yet
2026-03-24 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/9.jpg not downloaded yet
2026-03-24 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/10.jpg not downloaded yet
2026-03-24 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:08 [ayvens.be] INFO: Found listing with ID: 1981195
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981195%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [ayvens.be] INFO: Scrape type for 1981195: 1
2026-03-24 22:47:08 [ayvens.be] INFO: Extracting data for car ID: 1981195
2026-03-24 22:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195
2026-03-24 22:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bea68af-8c20-5867-a11f-bdf142cff75a with scrape type 1
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/1.jpg not downloaded yet
2026-03-24 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/2.jpg not downloaded yet
2026-03-24 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/3.jpg not downloaded yet
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911e3d0>
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/7.jpg saved to cache
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464d50>
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/10.jpg saved to cache
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/4.jpg not downloaded yet
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/5.jpg not downloaded yet
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009421bd0>
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/6.jpg saved to cache
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835bdd0>
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/2.jpg saved to cache
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2290>
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/1.jpg saved to cache
2026-03-24 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b210>
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/8.jpg saved to cache
2026-03-24 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094641d0>
2026-03-24 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Ff5c3af1106664aad821e6c6b21cb4b0a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/9.jpg saved to cache
2026-03-24 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57c50d68-de83-5965-b7b6-58c456a320f5
2026-03-24 22:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57c50d68-de83-5965-b7b6-58c456a320f5, skipping ID generation
2026-03-24 22:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57c50d68-de83-5965-b7b6-58c456a320f5 with scrape type 1
2026-03-24 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57c50d68-de83-5965-b7b6-58c456a320f5 sending to next pipeline
2026-03-24 22:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 57c50d68-de83-5965-b7b6-58c456a320f5, identifier: 1981193
2026-03-24 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382350>
2026-03-24 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/4.jpg saved to cache
2026-03-24 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193
2026-03-24 22:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193
2026-03-24 22:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193 to the API
2026-03-24 22:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '57c50d68-de83-5965-b7b6-58c456a320f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 114618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 935689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 924935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57c50d68-de83-5965-b7b6-58c456a320f5/57c50d68-de83-5965-b7b6-58c456a320f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/f5c3af1106664aad821e6c6b21cb4b0a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER 1.5 BLUEHDI 75KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S ACTIVE',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981193%27 HTTP/1.1" 200 None
2026-03-24 22:47:10 [ayvens.be] INFO: Saving data for 1981193: {'created_time': 1774392430.847746, 'last_price_update_time': 1774392430.847756, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981193') HTTP/1.1" 204 0
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/6.jpg not downloaded yet
2026-03-24 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/7.jpg not downloaded yet
2026-03-24 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/8.jpg not downloaded yet
2026-03-24 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/9.jpg not downloaded yet
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/10.jpg not downloaded yet
2026-03-24 22:47:11 [ayvens.be] INFO: Found listing with ID: 1981196
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981196%27 HTTP/1.1" 200 None
2026-03-24 22:47:11 [ayvens.be] INFO: Scrape type for 1981196: 1
2026-03-24 22:47:11 [ayvens.be] INFO: Extracting data for car ID: 1981196
2026-03-24 22:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196
2026-03-24 22:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a506822-a73a-5c8a-add2-85e191767713 with scrape type 1
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/1.jpg not downloaded yet
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963aa50>
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/5.jpg saved to cache
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/2.jpg not downloaded yet
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091310d0>
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/3.jpg saved to cache
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b0bd0>
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/6.jpg saved to cache
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/3.jpg not downloaded yet
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/4.jpg not downloaded yet
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bc150>
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/7.jpg saved to cache
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bd950>
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/9.jpg saved to cache
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b66b290>
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/8.jpg saved to cache
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/5.jpg not downloaded yet
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/6.jpg not downloaded yet
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf6890>
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/1.jpg saved to cache
2026-03-24 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009123250>
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/4.jpg saved to cache
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/7.jpg not downloaded yet
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/8.jpg not downloaded yet
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009759c10>
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/6.jpg saved to cache
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bcf10>
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/2.jpg saved to cache
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916c690>
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/3.jpg saved to cache
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098710d0>
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/5.jpg saved to cache
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910d250>
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/7.jpg saved to cache
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c0d0>
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faab84edd8538474e979c0754e3814a7e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/10.jpg saved to cache
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f
2026-03-24 22:47:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f, skipping ID generation
2026-03-24 22:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with scrape type 1
2026-03-24 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f sending to next pipeline
2026-03-24 22:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f, identifier: 1981194
2026-03-24 22:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194
2026-03-24 22:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194
2026-03-24 22:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194 to the API
2026-03-24 22:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '48c868ee-daee-58ba-aa22-9ccc0cb5cf9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BERLINE',
 'odometer': 86429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c868ee-daee-58ba-aa22-9ccc0cb5cf9f/48c868ee-daee-58ba-aa22-9ccc0cb5cf9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/aab84edd8538474e979c0754e3814a7e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BERLINE 1.6 E 200 D BUSINESS SOLUTION AUTO',
 'transmission': 'automatic',
 'trim': '1.6 E 200 D BUSINESS SOLUTION AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981194%27 HTTP/1.1" 200 None
2026-03-24 22:47:13 [ayvens.be] INFO: Saving data for 1981194: {'created_time': 1774392433.170293, 'last_price_update_time': 1774392433.170306, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981194') HTTP/1.1" 204 0
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/9.jpg not downloaded yet
2026-03-24 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/10.jpg not downloaded yet
2026-03-24 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:13 [ayvens.be] INFO: Found listing with ID: 1981197
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981197%27 HTTP/1.1" 200 None
2026-03-24 22:47:13 [ayvens.be] INFO: Scrape type for 1981197: 1
2026-03-24 22:47:13 [ayvens.be] INFO: Extracting data for car ID: 1981197
2026-03-24 22:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197
2026-03-24 22:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34bbce84-f627-506c-82ba-5e794d52266e with scrape type 1
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/1.jpg not downloaded yet
2026-03-24 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/2.jpg not downloaded yet
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/3.jpg not downloaded yet
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915dc90>
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/10.jpg saved to cache
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009123850>
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/8.jpg saved to cache
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359450>
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/4.jpg saved to cache
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/4.jpg not downloaded yet
2026-03-24 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/5.jpg not downloaded yet
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c650>
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/3.jpg saved to cache
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096ddd90>
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F8f8b70e66907466dbb5782c9d0bc9edd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/9.jpg saved to cache
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bea68af-8c20-5867-a11f-bdf142cff75a
2026-03-24 22:47:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bea68af-8c20-5867-a11f-bdf142cff75a, skipping ID generation
2026-03-24 22:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bea68af-8c20-5867-a11f-bdf142cff75a with scrape type 1
2026-03-24 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bea68af-8c20-5867-a11f-bdf142cff75a sending to next pipeline
2026-03-24 22:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4bea68af-8c20-5867-a11f-bdf142cff75a, identifier: 1981195
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083357d0>
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/1.jpg saved to cache
2026-03-24 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009190950>
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/2.jpg saved to cache
2026-03-24 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a05d0>
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/5.jpg saved to cache
2026-03-24 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/6.jpg not downloaded yet
2026-03-24 22:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195
2026-03-24 22:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195
2026-03-24 22:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195 to the API
2026-03-24 22:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4bea68af-8c20-5867-a11f-bdf142cff75a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 80642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bea68af-8c20-5867-a11f-bdf142cff75a/4bea68af-8c20-5867-a11f-bdf142cff75a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/8f8b70e66907466dbb5782c9d0bc9edd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.5 BLUEHDI 130 SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981195%27 HTTP/1.1" 200 None
2026-03-24 22:47:15 [ayvens.be] INFO: Saving data for 1981195: {'created_time': 1774392435.435781, 'last_price_update_time': 1774392435.435791, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981195') HTTP/1.1" 204 0
2026-03-24 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/7.jpg not downloaded yet
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fb850>
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/6.jpg saved to cache
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b9650>
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/7.jpg saved to cache
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/8.jpg not downloaded yet
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/9.jpg not downloaded yet
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013650>
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/9.jpg saved to cache
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096de210>
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/8.jpg saved to cache
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945c350>
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4b7c669acbaf420781079c015addfbd1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/10.jpg saved to cache
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a506822-a73a-5c8a-add2-85e191767713
2026-03-24 22:47:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a506822-a73a-5c8a-add2-85e191767713, skipping ID generation
2026-03-24 22:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a506822-a73a-5c8a-add2-85e191767713 with scrape type 1
2026-03-24 22:47:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a506822-a73a-5c8a-add2-85e191767713 sending to next pipeline
2026-03-24 22:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a506822-a73a-5c8a-add2-85e191767713, identifier: 1981196
2026-03-24 22:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196
2026-03-24 22:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196
2026-03-24 22:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196 to the API
2026-03-24 22:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1a506822-a73a-5c8a-add2-85e191767713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 68376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a506822-a73a-5c8a-add2-85e191767713/1a506822-a73a-5c8a-add2-85e191767713_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4b7c669acbaf420781079c015addfbd1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 1.3 GLB 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'automatic',
 'trim': '1.3 GLB 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981196%27 HTTP/1.1" 200 None
2026-03-24 22:47:17 [ayvens.be] INFO: Saving data for 1981196: {'created_time': 1774392437.036631, 'last_price_update_time': 1774392437.03664, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981196') HTTP/1.1" 204 0
2026-03-24 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/10.jpg not downloaded yet
2026-03-24 22:47:17 [ayvens.be] INFO: Found listing with ID: 1981198
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981198%27 HTTP/1.1" 200 None
2026-03-24 22:47:17 [ayvens.be] INFO: Scrape type for 1981198: 1
2026-03-24 22:47:17 [ayvens.be] INFO: Extracting data for car ID: 1981198
2026-03-24 22:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198
2026-03-24 22:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b12c27-b446-504a-96f4-31499a06ea19 with scrape type 1
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/1.jpg not downloaded yet
2026-03-24 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/2.jpg not downloaded yet
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/3.jpg not downloaded yet
2026-03-24 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/4.jpg not downloaded yet
2026-03-24 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/5.jpg not downloaded yet
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3950>
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/1.jpg saved to cache
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/6.jpg not downloaded yet
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f190>
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/3.jpg saved to cache
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009191510>
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/2.jpg saved to cache
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145610>
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/4.jpg saved to cache
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347c10>
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/5.jpg saved to cache
2026-03-24 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008308050>
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/7.jpg saved to cache
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/7.jpg not downloaded yet
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c39d0>
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/6.jpg saved to cache
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/8.jpg not downloaded yet
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/9.jpg not downloaded yet
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/10.jpg not downloaded yet
2026-03-24 22:47:18 [ayvens.be] INFO: Found listing with ID: 1981199
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981199%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [ayvens.be] INFO: Scrape type for 1981199: 1
2026-03-24 22:47:18 [ayvens.be] INFO: Extracting data for car ID: 1981199
2026-03-24 22:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199
2026-03-24 22:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1774da05-df84-53e8-b1ea-548cacdfce92 with scrape type 1
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/1.jpg not downloaded yet
2026-03-24 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/2.jpg not downloaded yet
2026-03-24 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/3.jpg not downloaded yet
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/4.jpg not downloaded yet
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/5.jpg not downloaded yet
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/6.jpg not downloaded yet
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/7.jpg not downloaded yet
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/8.jpg not downloaded yet
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2750>
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/9.jpg saved to cache
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407d90>
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/8.jpg saved to cache
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/9.jpg not downloaded yet
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945db90>
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/1.jpg saved to cache
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343f10>
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/2.jpg saved to cache
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911bdd0>
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fe5a3504a1a8b4467a54d84349f52b4c7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/10.jpg saved to cache
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34bbce84-f627-506c-82ba-5e794d52266e
2026-03-24 22:47:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34bbce84-f627-506c-82ba-5e794d52266e, skipping ID generation
2026-03-24 22:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34bbce84-f627-506c-82ba-5e794d52266e with scrape type 1
2026-03-24 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34bbce84-f627-506c-82ba-5e794d52266e sending to next pipeline
2026-03-24 22:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 34bbce84-f627-506c-82ba-5e794d52266e, identifier: 1981197
2026-03-24 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00c8f5d10>
2026-03-24 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/3.jpg saved to cache
2026-03-24 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fbcd0>
2026-03-24 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/4.jpg saved to cache
2026-03-24 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/10.jpg not downloaded yet
2026-03-24 22:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197
2026-03-24 22:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197
2026-03-24 22:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197 to the API
2026-03-24 22:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '34bbce84-f627-506c-82ba-5e794d52266e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 TOURING - 2019',
 'odometer': 99279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34bbce84-f627-506c-82ba-5e794d52266e/34bbce84-f627-506c-82ba-5e794d52266e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/e5a3504a1a8b4467a54d84349f52b4c7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 TOURING - 2019 318iA OPF',
 'transmission': 'automatic',
 'trim': '318iA OPF',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981197%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [ayvens.be] INFO: Saving data for 1981197: {'created_time': 1774392440.643883, 'last_price_update_time': 1774392440.643893, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981197') HTTP/1.1" 204 0
2026-03-24 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:20 [ayvens.be] INFO: Found listing with ID: 1981200
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981200%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [ayvens.be] INFO: Scrape type for 1981200: 1
2026-03-24 22:47:20 [ayvens.be] INFO: Extracting data for car ID: 1981200
2026-03-24 22:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200
2026-03-24 22:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with scrape type 1
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/1.jpg not downloaded yet
2026-03-24 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/2.jpg not downloaded yet
2026-03-24 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/3.jpg not downloaded yet
2026-03-24 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/4.jpg not downloaded yet
2026-03-24 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/5.jpg not downloaded yet
2026-03-24 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfe5d0>
2026-03-24 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/5.jpg saved to cache
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/6.jpg not downloaded yet
2026-03-24 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/7.jpg not downloaded yet
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/8.jpg not downloaded yet
2026-03-24 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911fa50>
2026-03-24 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/1.jpg saved to cache
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed0d50>
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/9.jpg saved to cache
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009448f10>
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/10.jpg saved to cache
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cdd90>
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/6.jpg saved to cache
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b71d0>
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/8.jpg saved to cache
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008373250>
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7e97c5f53bbd4386813af8fe8d7fb0f4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/7.jpg saved to cache
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05b12c27-b446-504a-96f4-31499a06ea19
2026-03-24 22:47:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05b12c27-b446-504a-96f4-31499a06ea19, skipping ID generation
2026-03-24 22:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b12c27-b446-504a-96f4-31499a06ea19 with scrape type 1
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05b12c27-b446-504a-96f4-31499a06ea19 sending to next pipeline
2026-03-24 22:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 05b12c27-b446-504a-96f4-31499a06ea19, identifier: 1981198
2026-03-24 22:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198
2026-03-24 22:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198
2026-03-24 22:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198 to the API
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '05b12c27-b446-504a-96f4-31499a06ea19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 83734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b12c27-b446-504a-96f4-31499a06ea19/05b12c27-b446-504a-96f4-31499a06ea19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7e97c5f53bbd4386813af8fe8d7fb0f4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981198%27 HTTP/1.1" 200 None
2026-03-24 22:47:21 [ayvens.be] INFO: Saving data for 1981198: {'created_time': 1774392441.927994, 'last_price_update_time': 1774392441.928006, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981198') HTTP/1.1" 204 0
2026-03-24 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/9.jpg not downloaded yet
2026-03-24 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/10.jpg not downloaded yet
2026-03-24 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009122510>
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/8.jpg saved to cache
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:22 [ayvens.be] INFO: Found listing with ID: 1981201
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981201%27 HTTP/1.1" 200 None
2026-03-24 22:47:22 [ayvens.be] INFO: Scrape type for 1981201: 1
2026-03-24 22:47:22 [ayvens.be] INFO: Extracting data for car ID: 1981201
2026-03-24 22:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201
2026-03-24 22:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with scrape type 1
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/1.jpg not downloaded yet
2026-03-24 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/2.jpg not downloaded yet
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009404250>
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/6.jpg saved to cache
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/3.jpg not downloaded yet
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d92d0>
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/9.jpg saved to cache
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094041d0>
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/3.jpg saved to cache
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914fb50>
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/4.jpg saved to cache
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/4.jpg not downloaded yet
2026-03-24 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009190950>
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/5.jpg saved to cache
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187490>
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/10.jpg saved to cache
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610b90>
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/7.jpg saved to cache
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083166d0>
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F80316f211c99442aae9db1e00a6dfb34%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/2.jpg saved to cache
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1774da05-df84-53e8-b1ea-548cacdfce92
2026-03-24 22:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1774da05-df84-53e8-b1ea-548cacdfce92, skipping ID generation
2026-03-24 22:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1774da05-df84-53e8-b1ea-548cacdfce92 with scrape type 1
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1774da05-df84-53e8-b1ea-548cacdfce92 sending to next pipeline
2026-03-24 22:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1774da05-df84-53e8-b1ea-548cacdfce92, identifier: 1981199
2026-03-24 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/5.jpg not downloaded yet
2026-03-24 22:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199
2026-03-24 22:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199
2026-03-24 22:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199 to the API
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1774da05-df84-53e8-b1ea-548cacdfce92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 85608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1774da05-df84-53e8-b1ea-548cacdfce92/1774da05-df84-53e8-b1ea-548cacdfce92_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/80316f211c99442aae9db1e00a6dfb34/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981199%27 HTTP/1.1" 200 None
2026-03-24 22:47:23 [ayvens.be] INFO: Saving data for 1981199: {'created_time': 1774392443.333041, 'last_price_update_time': 1774392443.333051, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981199') HTTP/1.1" 204 0
2026-03-24 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/6.jpg not downloaded yet
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009759b10>
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/1.jpg saved to cache
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/7.jpg not downloaded yet
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975a410>
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/6.jpg saved to cache
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/8.jpg not downloaded yet
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009198c10>
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/7.jpg saved to cache
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917e910>
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/2.jpg saved to cache
2026-03-24 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed2e50>
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/8.jpg saved to cache
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094590d0>
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/5.jpg saved to cache
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b547150>
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/3.jpg saved to cache
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945bbd0>
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/4.jpg saved to cache
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/9.jpg not downloaded yet
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/10.jpg not downloaded yet
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009198b90>
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/9.jpg saved to cache
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:24 [ayvens.be] INFO: Found listing with ID: 1981202
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981202%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [ayvens.be] INFO: Scrape type for 1981202: 1
2026-03-24 22:47:24 [ayvens.be] INFO: Extracting data for car ID: 1981202
2026-03-24 22:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202
2026-03-24 22:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with scrape type 1
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/1.jpg not downloaded yet
2026-03-24 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/2.jpg not downloaded yet
2026-03-24 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/3.jpg not downloaded yet
2026-03-24 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/4.jpg not downloaded yet
2026-03-24 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/5.jpg not downloaded yet
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/6.jpg not downloaded yet
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008399850>
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fbe1d3f7ae66f400fa41ae58646b1abfd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/10.jpg saved to cache
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14
2026-03-24 22:47:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14, skipping ID generation
2026-03-24 22:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with scrape type 1
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 sending to next pipeline
2026-03-24 22:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14, identifier: 1981200
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/7.jpg not downloaded yet
2026-03-24 22:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200
2026-03-24 22:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200
2026-03-24 22:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200 to the API
2026-03-24 22:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 93886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14/ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/be1d3f7ae66f400fa41ae58646b1abfd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981200%27 HTTP/1.1" 200 None
2026-03-24 22:47:25 [ayvens.be] INFO: Saving data for 1981200: {'created_time': 1774392445.185101, 'last_price_update_time': 1774392445.185111, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981200') HTTP/1.1" 204 0
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008344310>
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/3.jpg saved to cache
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008384210>
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/6.jpg saved to cache
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083878d0>
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/5.jpg saved to cache
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009614890>
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/1.jpg saved to cache
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094920d0>
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/4.jpg saved to cache
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835ad50>
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/2.jpg saved to cache
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/8.jpg not downloaded yet
2026-03-24 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/9.jpg not downloaded yet
2026-03-24 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/10.jpg not downloaded yet
2026-03-24 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:25 [ayvens.be] INFO: Found listing with ID: 1981203
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981203%27 HTTP/1.1" 200 None
2026-03-24 22:47:25 [ayvens.be] INFO: Scrape type for 1981203: 1
2026-03-24 22:47:25 [ayvens.be] INFO: Extracting data for car ID: 1981203
2026-03-24 22:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203
2026-03-24 22:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 005dbb32-469c-5d45-ba42-34d252124796 with scrape type 1
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/1.jpg not downloaded yet
2026-03-24 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/2.jpg not downloaded yet
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336790>
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/10.jpg saved to cache
2026-03-24 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/3.jpg not downloaded yet
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009611190>
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/7.jpg saved to cache
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913cd50>
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/8.jpg saved to cache
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083160d0>
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fea919738a36548b49bdb87eff11ae45f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/9.jpg saved to cache
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6
2026-03-24 22:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6, skipping ID generation
2026-03-24 22:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with scrape type 1
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 sending to next pipeline
2026-03-24 22:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6, identifier: 1981201
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/4.jpg not downloaded yet
2026-03-24 22:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201
2026-03-24 22:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201
2026-03-24 22:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201 to the API
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60 - 2018',
 'odometer': 80523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6/cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/ea919738a36548b49bdb87eff11ae45f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 - 2018 2.0 T6 AWD PHEV Inscription Expression',
 'transmission': 'automatic',
 'trim': '2.0 T6 AWD PHEV Inscription Expression',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981201%27 HTTP/1.1" 200 None
2026-03-24 22:47:26 [ayvens.be] INFO: Saving data for 1981201: {'created_time': 1774392446.749302, 'last_price_update_time': 1774392446.74931, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981201') HTTP/1.1" 204 0
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c38d0>
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/3.jpg saved to cache
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911ac90>
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/2.jpg saved to cache
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/5.jpg not downloaded yet
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bf710>
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/1.jpg saved to cache
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a2ed0>
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/4.jpg saved to cache
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/6.jpg not downloaded yet
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b7ce810>
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/5.jpg saved to cache
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fad90>
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/6.jpg saved to cache
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/7.jpg not downloaded yet
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/8.jpg not downloaded yet
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945f910>
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/7.jpg saved to cache
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944bdd0>
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/8.jpg saved to cache
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bbbd0>
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/10.jpg saved to cache
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083244d0>
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F089413bba5204016b19262f1d190057f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/9.jpg saved to cache
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8
2026-03-24 22:47:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8, skipping ID generation
2026-03-24 22:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with scrape type 1
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 sending to next pipeline
2026-03-24 22:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8, identifier: 1981202
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/9.jpg not downloaded yet
2026-03-24 22:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202
2026-03-24 22:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202
2026-03-24 22:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202 to the API
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'd04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 79813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8/d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/089413bba5204016b19262f1d190057f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981202%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [ayvens.be] INFO: Saving data for 1981202: {'created_time': 1774392448.046199, 'last_price_update_time': 1774392448.046209, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981202') HTTP/1.1" 204 0
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/10.jpg not downloaded yet
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [ayvens.be] INFO: Found listing with ID: 1981204
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981204%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [ayvens.be] INFO: Scrape type for 1981204: 1
2026-03-24 22:47:28 [ayvens.be] INFO: Extracting data for car ID: 1981204
2026-03-24 22:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204
2026-03-24 22:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with scrape type 1
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/1.jpg not downloaded yet
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/2.jpg not downloaded yet
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/3.jpg not downloaded yet
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/4.jpg not downloaded yet
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/5.jpg not downloaded yet
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b1710>
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/1.jpg saved to cache
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/6.jpg not downloaded yet
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009758e90>
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/2.jpg saved to cache
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/7.jpg not downloaded yet
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145fd0>
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/3.jpg saved to cache
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aaf50>
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/4.jpg saved to cache
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873010>
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/5.jpg saved to cache
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c60d0>
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/7.jpg saved to cache
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3110>
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/6.jpg saved to cache
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/8.jpg not downloaded yet
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/9.jpg not downloaded yet
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/10.jpg not downloaded yet
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [ayvens.be] INFO: Found listing with ID: 1981205
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981205%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [ayvens.be] INFO: Scrape type for 1981205: 1
2026-03-24 22:47:28 [ayvens.be] INFO: Extracting data for car ID: 1981205
2026-03-24 22:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205
2026-03-24 22:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 928ce10f-74ef-57ff-b729-f4a26d193dc0 with scrape type 1
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/1.jpg not downloaded yet
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/2.jpg not downloaded yet
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/3.jpg not downloaded yet
2026-03-24 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/4.jpg not downloaded yet
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009466410>
2026-03-24 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/8.jpg saved to cache
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/5.jpg not downloaded yet
2026-03-24 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3d90>
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/2.jpg saved to cache
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945a010>
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/1.jpg saved to cache
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/6.jpg not downloaded yet
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083129d0>
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/5.jpg saved to cache
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916cd50>
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/3.jpg saved to cache
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664650>
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/9.jpg saved to cache
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008324410>
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/4.jpg saved to cache
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff01824a890>
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F866c4f16eab34c299fa3eaf53306f6a6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/10.jpg saved to cache
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 005dbb32-469c-5d45-ba42-34d252124796
2026-03-24 22:47:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 005dbb32-469c-5d45-ba42-34d252124796, skipping ID generation
2026-03-24 22:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 005dbb32-469c-5d45-ba42-34d252124796 with scrape type 1
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 005dbb32-469c-5d45-ba42-34d252124796 sending to next pipeline
2026-03-24 22:47:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 005dbb32-469c-5d45-ba42-34d252124796, identifier: 1981203
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b5b50>
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/6.jpg saved to cache
2026-03-24 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/7.jpg not downloaded yet
2026-03-24 22:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203
2026-03-24 22:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203
2026-03-24 22:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203 to the API
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '005dbb32-469c-5d45-ba42-34d252124796',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS BREAK',
 'odometer': 149159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_005dbb32-469c-5d45-ba42-34d252124796/005dbb32-469c-5d45-ba42-34d252124796_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/866c4f16eab34c299fa3eaf53306f6a6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS BREAK 2.0 C 300 E BUSINESS SOLUTION AUTO',
 'transmission': 'automatic',
 'trim': '2.0 C 300 E BUSINESS SOLUTION AUTO',
 'vin': None,
 'year': 2020}
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981203%27 HTTP/1.1" 200 None
2026-03-24 22:47:30 [ayvens.be] INFO: Saving data for 1981203: {'created_time': 1774392450.357066, 'last_price_update_time': 1774392450.357076, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981203') HTTP/1.1" 204 0
2026-03-24 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/8.jpg not downloaded yet
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009617b90>
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/8.jpg saved to cache
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/9.jpg not downloaded yet
2026-03-24 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/10.jpg not downloaded yet
2026-03-24 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442c10>
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/9.jpg saved to cache
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:30 [ayvens.be] INFO: Found listing with ID: 1981206
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981206%27 HTTP/1.1" 200 None
2026-03-24 22:47:30 [ayvens.be] INFO: Scrape type for 1981206: 1
2026-03-24 22:47:30 [ayvens.be] INFO: Extracting data for car ID: 1981206
2026-03-24 22:47:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206
2026-03-24 22:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2681e870-05d3-5d78-8689-4aa49350be88 with scrape type 1
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/1.jpg not downloaded yet
2026-03-24 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/2.jpg not downloaded yet
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910d4d0>
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/7.jpg saved to cache
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835af50>
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/2.jpg saved to cache
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083080d0>
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F0405a9df332247969b88378b1c044b12%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/10.jpg saved to cache
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d
2026-03-24 22:47:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d, skipping ID generation
2026-03-24 22:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with scrape type 1
2026-03-24 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d sending to next pipeline
2026-03-24 22:47:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d, identifier: 1981204
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ed3d0>
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/1.jpg saved to cache
2026-03-24 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204
2026-03-24 22:47:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204
2026-03-24 22:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204 to the API
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '4a976dcd-9bb9-53e0-8d92-ebc8af6a984d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 77490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a976dcd-9bb9-53e0-8d92-ebc8af6a984d/4a976dcd-9bb9-53e0-8d92-ebc8af6a984d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/0405a9df332247969b88378b1c044b12/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 ADVANCED AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ADVANCED AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981204%27 HTTP/1.1" 200 None
2026-03-24 22:47:31 [ayvens.be] INFO: Saving data for 1981204: {'created_time': 1774392451.848277, 'last_price_update_time': 1774392451.848287, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981204') HTTP/1.1" 204 0
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009118350>
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/3.jpg saved to cache
2026-03-24 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/3.jpg not downloaded yet
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945d290>
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/4.jpg saved to cache
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4d50>
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/5.jpg saved to cache
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/4.jpg not downloaded yet
2026-03-24 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/5.jpg not downloaded yet
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b66afd0>
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/6.jpg saved to cache
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/6.jpg not downloaded yet
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009118950>
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/9.jpg saved to cache
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd410>
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/10.jpg saved to cache
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/7.jpg not downloaded yet
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/8.jpg not downloaded yet
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917ffd0>
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/8.jpg saved to cache
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422d90>
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F88b686cd3b1348d990edab606e65b3ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/7.jpg saved to cache
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 928ce10f-74ef-57ff-b729-f4a26d193dc0
2026-03-24 22:47:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 928ce10f-74ef-57ff-b729-f4a26d193dc0, skipping ID generation
2026-03-24 22:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 928ce10f-74ef-57ff-b729-f4a26d193dc0 with scrape type 1
2026-03-24 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 928ce10f-74ef-57ff-b729-f4a26d193dc0 sending to next pipeline
2026-03-24 22:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 928ce10f-74ef-57ff-b729-f4a26d193dc0, identifier: 1981205
2026-03-24 22:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205
2026-03-24 22:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205
2026-03-24 22:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205 to the API
2026-03-24 22:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '928ce10f-74ef-57ff-b729-f4a26d193dc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 96704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_928ce10f-74ef-57ff-b729-f4a26d193dc0/928ce10f-74ef-57ff-b729-f4a26d193dc0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/88b686cd3b1348d990edab606e65b3ef/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 T-GDI HYBRID FEEL AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI HYBRID FEEL AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981205%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [ayvens.be] INFO: Saving data for 1981205: {'created_time': 1774392453.19435, 'last_price_update_time': 1774392453.19436, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981205') HTTP/1.1" 204 0
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/9.jpg not downloaded yet
2026-03-24 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/10.jpg not downloaded yet
2026-03-24 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:33 [ayvens.be] INFO: Found listing with ID: 1981207
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981207%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [ayvens.be] INFO: Scrape type for 1981207: 1
2026-03-24 22:47:33 [ayvens.be] INFO: Extracting data for car ID: 1981207
2026-03-24 22:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207
2026-03-24 22:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with scrape type 1
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/1.jpg not downloaded yet
2026-03-24 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/2.jpg not downloaded yet
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/3.jpg not downloaded yet
2026-03-24 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/4.jpg not downloaded yet
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cd1d0>
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/1.jpg saved to cache
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094abb50>
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/2.jpg saved to cache
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/5.jpg not downloaded yet
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a9110>
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/6.jpg saved to cache
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/6.jpg not downloaded yet
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aa750>
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/3.jpg saved to cache
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be0d0>
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/5.jpg saved to cache
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917ca50>
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/4.jpg saved to cache
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/7.jpg not downloaded yet
2026-03-24 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed2310>
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/7.jpg saved to cache
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/8.jpg not downloaded yet
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/9.jpg not downloaded yet
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964c310>
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/8.jpg saved to cache
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/10.jpg not downloaded yet
2026-03-24 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed0150>
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/9.jpg saved to cache
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c2d0>
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F9095702e81814e3a80d3d6a3d21279b8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/10.jpg saved to cache
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2681e870-05d3-5d78-8689-4aa49350be88
2026-03-24 22:47:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2681e870-05d3-5d78-8689-4aa49350be88, skipping ID generation
2026-03-24 22:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2681e870-05d3-5d78-8689-4aa49350be88 with scrape type 1
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2681e870-05d3-5d78-8689-4aa49350be88 sending to next pipeline
2026-03-24 22:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2681e870-05d3-5d78-8689-4aa49350be88, identifier: 1981206
2026-03-24 22:47:34 [ayvens.be] INFO: Found listing with ID: 1981208
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981208%27 HTTP/1.1" 200 None
2026-03-24 22:47:34 [ayvens.be] INFO: Scrape type for 1981208: 1
2026-03-24 22:47:34 [ayvens.be] INFO: Extracting data for car ID: 1981208
2026-03-24 22:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208
2026-03-24 22:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283ccbef-d068-51ad-a5a8-b2001efa15e6 with scrape type 1
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/1.jpg not downloaded yet
2026-03-24 22:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206
2026-03-24 22:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206
2026-03-24 22:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206 to the API
2026-03-24 22:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2681e870-05d3-5d78-8689-4aa49350be88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 45482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2681e870-05d3-5d78-8689-4aa49350be88/2681e870-05d3-5d78-8689-4aa49350be88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/9095702e81814e3a80d3d6a3d21279b8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981206%27 HTTP/1.1" 200 None
2026-03-24 22:47:35 [ayvens.be] INFO: Saving data for 1981206: {'created_time': 1774392455.145681, 'last_price_update_time': 1774392455.1457, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981206') HTTP/1.1" 204 0
2026-03-24 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/2.jpg not downloaded yet
2026-03-24 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641a10>
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/2.jpg saved to cache
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913d110>
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/1.jpg saved to cache
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/3.jpg not downloaded yet
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/4.jpg not downloaded yet
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009186bd0>
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/3.jpg saved to cache
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128950>
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/4.jpg saved to cache
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/5.jpg not downloaded yet
2026-03-24 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009759710>
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/5.jpg saved to cache
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/6.jpg not downloaded yet
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/7.jpg not downloaded yet
2026-03-24 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/8.jpg not downloaded yet
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975aad0>
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/7.jpg saved to cache
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/9.jpg not downloaded yet
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009860890>
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/6.jpg saved to cache
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/10.jpg not downloaded yet
2026-03-24 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091461d0>
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/8.jpg saved to cache
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:36 [ayvens.be] INFO: Found listing with ID: 1981209
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981209%27 HTTP/1.1" 200 None
2026-03-24 22:47:36 [ayvens.be] INFO: Scrape type for 1981209: 1
2026-03-24 22:47:36 [ayvens.be] INFO: Extracting data for car ID: 1981209
2026-03-24 22:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209
2026-03-24 22:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a007cff-3ab3-5401-9d18-ffd29573a611 with scrape type 1
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/1.jpg not downloaded yet
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/2.jpg not downloaded yet
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083275d0>
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/9.jpg saved to cache
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/3.jpg not downloaded yet
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945e650>
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/1.jpg saved to cache
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bf510>
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/2.jpg saved to cache
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bb190>
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3374eec7f2554352bacea8da2aa6f80d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/10.jpg saved to cache
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850
2026-03-24 22:47:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4510b0a-1cbc-5e8a-8d83-d53fc2273850, skipping ID generation
2026-03-24 22:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with scrape type 1
2026-03-24 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850 sending to next pipeline
2026-03-24 22:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c4510b0a-1cbc-5e8a-8d83-d53fc2273850, identifier: 1981207
2026-03-24 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207
2026-03-24 22:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207
2026-03-24 22:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207 to the API
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'c4510b0a-1cbc-5e8a-8d83-d53fc2273850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 94084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 833377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 838487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4510b0a-1cbc-5e8a-8d83-d53fc2273850/c4510b0a-1cbc-5e8a-8d83-d53fc2273850_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 871175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3374eec7f2554352bacea8da2aa6f80d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981207%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [ayvens.be] INFO: Saving data for 1981207: {'created_time': 1774392457.061012, 'last_price_update_time': 1774392457.061022, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981207') HTTP/1.1" 204 0
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/4.jpg not downloaded yet
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/5.jpg not downloaded yet
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a610>
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/3.jpg saved to cache
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/6.jpg not downloaded yet
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/7.jpg not downloaded yet
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911b510>
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/4.jpg saved to cache
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013b90>
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/5.jpg saved to cache
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910c910>
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/6.jpg saved to cache
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/8.jpg not downloaded yet
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/9.jpg not downloaded yet
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8dd0>
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/7.jpg saved to cache
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/10.jpg not downloaded yet
2026-03-24 22:47:37 [ayvens.be] INFO: Found listing with ID: 1981210
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981210%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [ayvens.be] INFO: Scrape type for 1981210: 1
2026-03-24 22:47:37 [ayvens.be] INFO: Extracting data for car ID: 1981210
2026-03-24 22:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210
2026-03-24 22:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with scrape type 1
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/1.jpg not downloaded yet
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009132750>
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/1.jpg saved to cache
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872150>
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/3.jpg saved to cache
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a2f90>
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/8.jpg saved to cache
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009467610>
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/10.jpg saved to cache
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009120450>
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fe8603a5eac5e4968b5c58777bf9a663a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/9.jpg saved to cache
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 283ccbef-d068-51ad-a5a8-b2001efa15e6
2026-03-24 22:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 283ccbef-d068-51ad-a5a8-b2001efa15e6, skipping ID generation
2026-03-24 22:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283ccbef-d068-51ad-a5a8-b2001efa15e6 with scrape type 1
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 283ccbef-d068-51ad-a5a8-b2001efa15e6 sending to next pipeline
2026-03-24 22:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 283ccbef-d068-51ad-a5a8-b2001efa15e6, identifier: 1981208
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7590>
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/2.jpg saved to cache
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a0b90>
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/4.jpg saved to cache
2026-03-24 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208
2026-03-24 22:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208
2026-03-24 22:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208 to the API
2026-03-24 22:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '283ccbef-d068-51ad-a5a8-b2001efa15e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2-serie',
 'odometer': 150247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 874412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_283ccbef-d068-51ad-a5a8-b2001efa15e6/283ccbef-d068-51ad-a5a8-b2001efa15e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/e8603a5eac5e4968b5c58777bf9a663a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2-serie 2.0 218DA (100KW) GRAN COUPE',
 'transmission': 'automatic',
 'trim': '2.0 218DA (100KW) GRAN COUPE',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981208%27 HTTP/1.1" 200 None
2026-03-24 22:47:39 [ayvens.be] INFO: Saving data for 1981208: {'created_time': 1774392459.272674, 'last_price_update_time': 1774392459.272683, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981208') HTTP/1.1" 204 0
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/2.jpg not downloaded yet
2026-03-24 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091770d0>
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/5.jpg saved to cache
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/3.jpg not downloaded yet
2026-03-24 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/4.jpg not downloaded yet
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685750>
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/6.jpg saved to cache
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/5.jpg not downloaded yet
2026-03-24 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/6.jpg not downloaded yet
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613110>
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/7.jpg saved to cache
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/7.jpg not downloaded yet
2026-03-24 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/8.jpg not downloaded yet
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335610>
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/8.jpg saved to cache
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009465a90>
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/9.jpg saved to cache
2026-03-24 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938c890>
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F0a55dc68c5d641d5bf4fbd09c60b8ac8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/10.jpg saved to cache
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a007cff-3ab3-5401-9d18-ffd29573a611
2026-03-24 22:47:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a007cff-3ab3-5401-9d18-ffd29573a611, skipping ID generation
2026-03-24 22:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a007cff-3ab3-5401-9d18-ffd29573a611 with scrape type 1
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a007cff-3ab3-5401-9d18-ffd29573a611 sending to next pipeline
2026-03-24 22:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a007cff-3ab3-5401-9d18-ffd29573a611, identifier: 1981209
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/9.jpg not downloaded yet
2026-03-24 22:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209
2026-03-24 22:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209
2026-03-24 22:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209 to the API
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8a007cff-3ab3-5401-9d18-ffd29573a611',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 119243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a007cff-3ab3-5401-9d18-ffd29573a611/8a007cff-3ab3-5401-9d18-ffd29573a611_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/0a55dc68c5d641d5bf4fbd09c60b8ac8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981209%27 HTTP/1.1" 200 None
2026-03-24 22:47:40 [ayvens.be] INFO: Saving data for 1981209: {'created_time': 1774392460.549924, 'last_price_update_time': 1774392460.549934, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981209') HTTP/1.1" 204 0
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/10.jpg not downloaded yet
2026-03-24 22:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c550>
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/2.jpg saved to cache
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6e02d0>
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/1.jpg saved to cache
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:40 [ayvens.be] INFO: Found listing with ID: 1981211
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981211%27 HTTP/1.1" 200 None
2026-03-24 22:47:40 [ayvens.be] INFO: Scrape type for 1981211: 1
2026-03-24 22:47:40 [ayvens.be] INFO: Extracting data for car ID: 1981211
2026-03-24 22:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211
2026-03-24 22:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with scrape type 1
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/1.jpg not downloaded yet
2026-03-24 22:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/2.jpg not downloaded yet
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871c90>
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/3.jpg saved to cache
2026-03-24 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083124d0>
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/4.jpg saved to cache
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/3.jpg not downloaded yet
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/4.jpg not downloaded yet
2026-03-24 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664a10>
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/5.jpg saved to cache
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008342fd0>
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/6.jpg saved to cache
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/5.jpg not downloaded yet
2026-03-24 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/6.jpg not downloaded yet
2026-03-24 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938d610>
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/7.jpg saved to cache
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009614250>
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/8.jpg saved to cache
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/7.jpg not downloaded yet
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/8.jpg not downloaded yet
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a7fd0>
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/9.jpg saved to cache
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093959d0>
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fb3ee5e5424e5413f931e726732ca974a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/10.jpg saved to cache
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1
2026-03-24 22:47:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6928d62f-759b-5f8e-a563-9425c1dcbdf1, skipping ID generation
2026-03-24 22:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with scrape type 1
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1 sending to next pipeline
2026-03-24 22:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6928d62f-759b-5f8e-a563-9425c1dcbdf1, identifier: 1981210
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/9.jpg not downloaded yet
2026-03-24 22:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210
2026-03-24 22:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210
2026-03-24 22:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210 to the API
2026-03-24 22:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '6928d62f-759b-5f8e-a563-9425c1dcbdf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQC',
 'odometer': 104505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6928d62f-759b-5f8e-a563-9425c1dcbdf1/6928d62f-759b-5f8e-a563-9425c1dcbdf1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/b3ee5e5424e5413f931e726732ca974a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQC BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'transmission': 'automatic',
 'trim': 'BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981210%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [ayvens.be] INFO: Saving data for 1981210: {'created_time': 1774392462.23734, 'last_price_update_time': 1774392462.23735, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981210') HTTP/1.1" 204 0
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/10.jpg not downloaded yet
2026-03-24 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:42 [ayvens.be] INFO: Found listing with ID: 1981212
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981212%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [ayvens.be] INFO: Scrape type for 1981212: 1
2026-03-24 22:47:42 [ayvens.be] INFO: Extracting data for car ID: 1981212
2026-03-24 22:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212
2026-03-24 22:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4958349f-6e0c-51eb-a850-148d060247e2 with scrape type 1
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/1.jpg not downloaded yet
2026-03-24 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/2.jpg not downloaded yet
2026-03-24 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/3.jpg not downloaded yet
2026-03-24 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/4.jpg not downloaded yet
2026-03-24 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/5.jpg not downloaded yet
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963b590>
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/1.jpg saved to cache
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009395e50>
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/2.jpg saved to cache
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/6.jpg not downloaded yet
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091af0d0>
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/3.jpg saved to cache
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/7.jpg not downloaded yet
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/8.jpg not downloaded yet
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c090>
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/4.jpg saved to cache
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008344c10>
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/5.jpg saved to cache
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c050>
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/7.jpg saved to cache
2026-03-24 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f8550>
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/6.jpg saved to cache
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/9.jpg not downloaded yet
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/10.jpg not downloaded yet
2026-03-24 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:43 [ayvens.be] INFO: Found listing with ID: 1981213
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981213%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [ayvens.be] INFO: Scrape type for 1981213: 1
2026-03-24 22:47:43 [ayvens.be] INFO: Extracting data for car ID: 1981213
2026-03-24 22:47:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213
2026-03-24 22:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with scrape type 1
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/1.jpg not downloaded yet
2026-03-24 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/2.jpg not downloaded yet
2026-03-24 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/3.jpg not downloaded yet
2026-03-24 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/4.jpg not downloaded yet
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/5.jpg not downloaded yet
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/6.jpg not downloaded yet
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441710>
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/2.jpg saved to cache
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/7.jpg not downloaded yet
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/8.jpg not downloaded yet
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/9.jpg not downloaded yet
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834e290>
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/9.jpg saved to cache
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119690>
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/1.jpg saved to cache
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed32d0>
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/10.jpg saved to cache
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369310>
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/3.jpg saved to cache
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a19d0>
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252F894c965fbc7345f0addabc26ec687184%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/8.jpg saved to cache
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424
2026-03-24 22:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424, skipping ID generation
2026-03-24 22:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with scrape type 1
2026-03-24 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 sending to next pipeline
2026-03-24 22:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424, identifier: 1981211
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b78710>
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/4.jpg saved to cache
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1dfad0>
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/5.jpg saved to cache
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211
2026-03-24 22:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211
2026-03-24 22:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211 to the API
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9e7d8078-cf36-5dd2-bd67-3145a3dbb424',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 145571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 866148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e7d8078-cf36-5dd2-bd67-3145a3dbb424/9e7d8078-cf36-5dd2-bd67-3145a3dbb424_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/894c965fbc7345f0addabc26ec687184/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 85KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981211%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [ayvens.be] INFO: Saving data for 1981211: {'created_time': 1774392464.538009, 'last_price_update_time': 1774392464.538018, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981211') HTTP/1.1" 204 0
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/10.jpg not downloaded yet
2026-03-24 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:44 [ayvens.be] INFO: Found listing with ID: 1981214
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981214%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [ayvens.be] INFO: Scrape type for 1981214: 1
2026-03-24 22:47:44 [ayvens.be] INFO: Extracting data for car ID: 1981214
2026-03-24 22:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214
2026-03-24 22:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccef6b72-81c5-575a-82e1-8e8a07591d49 with scrape type 1
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/1.jpg not downloaded yet
2026-03-24 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/2.jpg not downloaded yet
2026-03-24 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/3.jpg not downloaded yet
2026-03-24 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/4.jpg not downloaded yet
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/5.jpg not downloaded yet
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094649d0>
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/7.jpg saved to cache
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/6.jpg not downloaded yet
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/7.jpg not downloaded yet
2026-03-24 22:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/8.jpg not downloaded yet
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093973d0>
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/6.jpg saved to cache
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944a490>
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/8.jpg saved to cache
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a4910>
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/1.jpg saved to cache
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008313250>
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/2.jpg saved to cache
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a6e50>
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/9.jpg saved to cache
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347c90>
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F26a94f7866ff4b8494a272ba6e8f081c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/10.jpg saved to cache
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4958349f-6e0c-51eb-a850-148d060247e2
2026-03-24 22:47:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4958349f-6e0c-51eb-a850-148d060247e2, skipping ID generation
2026-03-24 22:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4958349f-6e0c-51eb-a850-148d060247e2 with scrape type 1
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4958349f-6e0c-51eb-a850-148d060247e2 sending to next pipeline
2026-03-24 22:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4958349f-6e0c-51eb-a850-148d060247e2, identifier: 1981212
2026-03-24 22:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212
2026-03-24 22:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212
2026-03-24 22:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212 to the API
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4958349f-6e0c-51eb-a850-148d060247e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 179602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4958349f-6e0c-51eb-a850-148d060247e2/4958349f-6e0c-51eb-a850-148d060247e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/26a94f7866ff4b8494a272ba6e8f081c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'vin': None,
 'year': 2020}
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981212%27 HTTP/1.1" 200 None
2026-03-24 22:47:45 [ayvens.be] INFO: Saving data for 1981212: {'created_time': 1774392465.853319, 'last_price_update_time': 1774392465.853329, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981212') HTTP/1.1" 204 0
2026-03-24 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/9.jpg not downloaded yet
2026-03-24 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/10.jpg not downloaded yet
2026-03-24 22:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175c90>
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/10.jpg saved to cache
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:46 [ayvens.be] INFO: Found listing with ID: 1981215
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981215%27 HTTP/1.1" 200 None
2026-03-24 22:47:46 [ayvens.be] INFO: Scrape type for 1981215: 1
2026-03-24 22:47:46 [ayvens.be] INFO: Extracting data for car ID: 1981215
2026-03-24 22:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215
2026-03-24 22:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc014a8-d2c4-5088-9e89-c21108672e4c with scrape type 1
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/1.jpg not downloaded yet
2026-03-24 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/2.jpg not downloaded yet
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008399190>
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/9.jpg saved to cache
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c3f10>
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/5.jpg saved to cache
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3010>
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/4.jpg saved to cache
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/3.jpg not downloaded yet
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492510>
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/7.jpg saved to cache
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/4.jpg not downloaded yet
2026-03-24 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009009810>
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/6.jpg saved to cache
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335b10>
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/8.jpg saved to cache
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/5.jpg not downloaded yet
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d03e10>
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F1e663c0faf224092bbd0b6e36cc07454%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/3.jpg saved to cache
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56
2026-03-24 22:47:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56, skipping ID generation
2026-03-24 22:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with scrape type 1
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 sending to next pipeline
2026-03-24 22:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56, identifier: 1981213
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/6.jpg not downloaded yet
2026-03-24 22:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213
2026-03-24 22:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213
2026-03-24 22:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213 to the API
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 92742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56/dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/1e663c0faf224092bbd0b6e36cc07454/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981213%27 HTTP/1.1" 200 None
2026-03-24 22:47:47 [ayvens.be] INFO: Saving data for 1981213: {'created_time': 1774392467.524694, 'last_price_update_time': 1774392467.524703, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981213') HTTP/1.1" 204 0
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967fb90>
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/1.jpg saved to cache
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/7.jpg not downloaded yet
2026-03-24 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/8.jpg not downloaded yet
2026-03-24 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/9.jpg not downloaded yet
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/10.jpg not downloaded yet
2026-03-24 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:47 [ayvens.be] INFO: Found listing with ID: 1981216
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981216%27 HTTP/1.1" 200 None
2026-03-24 22:47:47 [ayvens.be] INFO: Scrape type for 1981216: 1
2026-03-24 22:47:47 [ayvens.be] INFO: Extracting data for car ID: 1981216
2026-03-24 22:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216
2026-03-24 22:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c718578a-7a51-5762-83df-cab4e808162f with scrape type 1
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/1.jpg not downloaded yet
2026-03-24 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/2.jpg not downloaded yet
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830b710>
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/2.jpg saved to cache
2026-03-24 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096162d0>
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/5.jpg saved to cache
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf5350>
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/4.jpg saved to cache
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/3.jpg not downloaded yet
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009616b10>
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/6.jpg saved to cache
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110050>
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/7.jpg saved to cache
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/4.jpg not downloaded yet
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/5.jpg not downloaded yet
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bcdfed0>
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/3.jpg saved to cache
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915d8d0>
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/8.jpg saved to cache
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945c910>
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/9.jpg saved to cache
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/6.jpg not downloaded yet
2026-03-24 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/7.jpg not downloaded yet
2026-03-24 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/8.jpg not downloaded yet
2026-03-24 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/9.jpg not downloaded yet
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/10.jpg not downloaded yet
2026-03-24 22:47:49 [ayvens.be] INFO: Found listing with ID: 1981217
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981217%27 HTTP/1.1" 200 None
2026-03-24 22:47:49 [ayvens.be] INFO: Scrape type for 1981217: 1
2026-03-24 22:47:49 [ayvens.be] INFO: Extracting data for car ID: 1981217
2026-03-24 22:47:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217
2026-03-24 22:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 856191d6-dee9-53b1-8504-abc7615c1d43 with scrape type 1
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/1.jpg not downloaded yet
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/2.jpg not downloaded yet
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946f390>
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/2.jpg saved to cache
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bd290>
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F07ba2deb0c754bf9a86ea443eb33df40%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/10.jpg saved to cache
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ccef6b72-81c5-575a-82e1-8e8a07591d49
2026-03-24 22:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccef6b72-81c5-575a-82e1-8e8a07591d49, skipping ID generation
2026-03-24 22:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccef6b72-81c5-575a-82e1-8e8a07591d49 with scrape type 1
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccef6b72-81c5-575a-82e1-8e8a07591d49 sending to next pipeline
2026-03-24 22:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ccef6b72-81c5-575a-82e1-8e8a07591d49, identifier: 1981214
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967c6d0>
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/4.jpg saved to cache
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112010>
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/1.jpg saved to cache
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131410>
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/3.jpg saved to cache
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009759110>
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/5.jpg saved to cache
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2410>
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/6.jpg saved to cache
2026-03-24 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009665710>
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/7.jpg saved to cache
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/3.jpg not downloaded yet
2026-03-24 22:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214
2026-03-24 22:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214
2026-03-24 22:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214 to the API
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ccef6b72-81c5-575a-82e1-8e8a07591d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 108361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccef6b72-81c5-575a-82e1-8e8a07591d49/ccef6b72-81c5-575a-82e1-8e8a07591d49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/07ba2deb0c754bf9a86ea443eb33df40/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981214%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [ayvens.be] INFO: Saving data for 1981214: {'created_time': 1774392470.370417, 'last_price_update_time': 1774392470.370426, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981214') HTTP/1.1" 204 0
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/4.jpg not downloaded yet
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/5.jpg not downloaded yet
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/6.jpg not downloaded yet
2026-03-24 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/7.jpg not downloaded yet
2026-03-24 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/8.jpg not downloaded yet
2026-03-24 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/9.jpg not downloaded yet
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/10.jpg not downloaded yet
2026-03-24 22:47:50 [ayvens.be] INFO: Found listing with ID: 1981218
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981218%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [ayvens.be] INFO: Scrape type for 1981218: 1
2026-03-24 22:47:50 [ayvens.be] INFO: Extracting data for car ID: 1981218
2026-03-24 22:47:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218
2026-03-24 22:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with scrape type 1
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/1.jpg not downloaded yet
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/2.jpg not downloaded yet
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008311090>
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/2.jpg saved to cache
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009687e50>
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/9.jpg saved to cache
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/3.jpg not downloaded yet
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a2650>
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/10.jpg saved to cache
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911ed90>
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/3.jpg saved to cache
2026-03-24 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911d0d0>
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/5.jpg saved to cache
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/4.jpg not downloaded yet
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/5.jpg not downloaded yet
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009118050>
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F22deab36f5e94c27ab5398e989a4c967%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/8.jpg saved to cache
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbc014a8-d2c4-5088-9e89-c21108672e4c
2026-03-24 22:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbc014a8-d2c4-5088-9e89-c21108672e4c, skipping ID generation
2026-03-24 22:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc014a8-d2c4-5088-9e89-c21108672e4c with scrape type 1
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbc014a8-d2c4-5088-9e89-c21108672e4c sending to next pipeline
2026-03-24 22:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fbc014a8-d2c4-5088-9e89-c21108672e4c, identifier: 1981215
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aecfb90>
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/1.jpg saved to cache
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912b4d0>
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/4.jpg saved to cache
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215
2026-03-24 22:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215
2026-03-24 22:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215 to the API
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fbc014a8-d2c4-5088-9e89-c21108672e4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK DIESEL - 2020',
 'odometer': 129280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc014a8-d2c4-5088-9e89-c21108672e4c/fbc014a8-d2c4-5088-9e89-c21108672e4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/22deab36f5e94c27ab5398e989a4c967/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK DIESEL - 2020 35 TDi Business Edition Advanced S '
          'tron.',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition Advanced S tron.',
 'vin': None,
 'year': 2020}
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981215%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [ayvens.be] INFO: Saving data for 1981215: {'created_time': 1774392471.77565, 'last_price_update_time': 1774392471.77566, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981215') HTTP/1.1" 204 0
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/6.jpg not downloaded yet
2026-03-24 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/7.jpg not downloaded yet
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/8.jpg not downloaded yet
2026-03-24 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/9.jpg not downloaded yet
2026-03-24 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/10.jpg not downloaded yet
2026-03-24 22:47:51 [ayvens.be] INFO: Found listing with ID: 1981219
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981219%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [ayvens.be] INFO: Scrape type for 1981219: 1
2026-03-24 22:47:51 [ayvens.be] INFO: Extracting data for car ID: 1981219
2026-03-24 22:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219
2026-03-24 22:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with scrape type 1
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/1.jpg not downloaded yet
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/2.jpg not downloaded yet
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009147d10>
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/7.jpg saved to cache
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009141e50>
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/6.jpg saved to cache
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347d10>
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/2.jpg saved to cache
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/3.jpg not downloaded yet
2026-03-24 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/4.jpg not downloaded yet
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a1cd0>
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/1.jpg saved to cache
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02310>
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/3.jpg saved to cache
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440c50>
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/8.jpg saved to cache
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ed850>
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/10.jpg saved to cache
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec5110>
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F26cc279032a14ab3b9d709e244cee406%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/9.jpg saved to cache
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c718578a-7a51-5762-83df-cab4e808162f
2026-03-24 22:47:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c718578a-7a51-5762-83df-cab4e808162f, skipping ID generation
2026-03-24 22:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c718578a-7a51-5762-83df-cab4e808162f with scrape type 1
2026-03-24 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c718578a-7a51-5762-83df-cab4e808162f sending to next pipeline
2026-03-24 22:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c718578a-7a51-5762-83df-cab4e808162f, identifier: 1981216
2026-03-24 22:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216
2026-03-24 22:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216
2026-03-24 22:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216 to the API
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c718578a-7a51-5762-83df-cab4e808162f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 110037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c718578a-7a51-5762-83df-cab4e808162f/c718578a-7a51-5762-83df-cab4e808162f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/26cc279032a14ab3b9d709e244cee406/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981216%27 HTTP/1.1" 200 None
2026-03-24 22:47:53 [ayvens.be] INFO: Saving data for 1981216: {'created_time': 1774392473.436078, 'last_price_update_time': 1774392473.436088, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981216') HTTP/1.1" 204 0
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/5.jpg not downloaded yet
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/6.jpg not downloaded yet
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f1790>
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/3.jpg saved to cache
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/7.jpg not downloaded yet
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/8.jpg not downloaded yet
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/9.jpg not downloaded yet
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309210>
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/2.jpg saved to cache
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009665bd0>
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/1.jpg saved to cache
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/10.jpg not downloaded yet
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2b3d0>
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/5.jpg saved to cache
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:53 [ayvens.be] INFO: Found listing with ID: 1981220
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981220%27 HTTP/1.1" 200 None
2026-03-24 22:47:53 [ayvens.be] INFO: Scrape type for 1981220: 1
2026-03-24 22:47:53 [ayvens.be] INFO: Extracting data for car ID: 1981220
2026-03-24 22:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220
2026-03-24 22:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with scrape type 1
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/1.jpg not downloaded yet
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fabd0>
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/6.jpg saved to cache
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6650>
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/10.jpg saved to cache
2026-03-24 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00986b490>
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/5.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009191d90>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/4.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/2.jpg not downloaded yet
2026-03-24 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/3.jpg not downloaded yet
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec50d0>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/9.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083248d0>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/4.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009129990>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/6.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/4.jpg not downloaded yet
2026-03-24 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/5.jpg not downloaded yet
2026-03-24 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00c8f2bd0>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/7.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/6.jpg not downloaded yet
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/7.jpg not downloaded yet
2026-03-24 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/8.jpg not downloaded yet
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a23d0>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/10.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009192510>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/3.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834fa90>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/9.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/9.jpg not downloaded yet
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/10.jpg not downloaded yet
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b1dd0>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/2.jpg saved to cache
2026-03-24 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405c90>
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/1.jpg saved to cache
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834ffd0>
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/8.jpg saved to cache
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:55 [ayvens.be] INFO: Found listing with ID: 1981221
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981221%27 HTTP/1.1" 200 None
2026-03-24 22:47:55 [ayvens.be] INFO: Scrape type for 1981221: 1
2026-03-24 22:47:55 [ayvens.be] INFO: Extracting data for car ID: 1981221
2026-03-24 22:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221
2026-03-24 22:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d63efcb-7417-5059-ac68-bf58c9cb6092 with scrape type 1
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/1.jpg not downloaded yet
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/2.jpg not downloaded yet
2026-03-24 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/3.jpg not downloaded yet
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091991d0>
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/4.jpg saved to cache
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/4.jpg not downloaded yet
2026-03-24 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/5.jpg not downloaded yet
2026-03-24 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008381350>
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/5.jpg saved to cache
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830bad0>
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6d15b6757bc7460aa6cf483c10fa5875%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/8.jpg saved to cache
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3
2026-03-24 22:47:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5ecc8af-05b8-5f20-b299-a2ada04e59d3, skipping ID generation
2026-03-24 22:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with scrape type 1
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3 sending to next pipeline
2026-03-24 22:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b5ecc8af-05b8-5f20-b299-a2ada04e59d3, identifier: 1981218
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917fe50>
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/6.jpg saved to cache
2026-03-24 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1dec50>
2026-03-24 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/7.jpg saved to cache
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/6.jpg not downloaded yet
2026-03-24 22:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218
2026-03-24 22:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218
2026-03-24 22:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218 to the API
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b5ecc8af-05b8-5f20-b299-a2ada04e59d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 167242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5ecc8af-05b8-5f20-b299-a2ada04e59d3/b5ecc8af-05b8-5f20-b299-a2ada04e59d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6d15b6757bc7460aa6cf483c10fa5875/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV Inscription',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV Inscription',
 'vin': None,
 'year': 2020}
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981218%27 HTTP/1.1" 200 None
2026-03-24 22:47:56 [ayvens.be] INFO: Saving data for 1981218: {'created_time': 1774392476.430579, 'last_price_update_time': 1774392476.43059, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981218') HTTP/1.1" 204 0
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/7.jpg not downloaded yet
2026-03-24 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/8.jpg not downloaded yet
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c250>
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/9.jpg saved to cache
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096137d0>
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/8.jpg saved to cache
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce590>
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F8996bfb036d34293b2d1857ff56c8174%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/7.jpg saved to cache
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 856191d6-dee9-53b1-8504-abc7615c1d43
2026-03-24 22:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 856191d6-dee9-53b1-8504-abc7615c1d43, skipping ID generation
2026-03-24 22:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 856191d6-dee9-53b1-8504-abc7615c1d43 with scrape type 1
2026-03-24 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 856191d6-dee9-53b1-8504-abc7615c1d43 sending to next pipeline
2026-03-24 22:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 856191d6-dee9-53b1-8504-abc7615c1d43, identifier: 1981217
2026-03-24 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217
2026-03-24 22:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217
2026-03-24 22:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217 to the API
2026-03-24 22:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '856191d6-dee9-53b1-8504-abc7615c1d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 79568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 822182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_856191d6-dee9-53b1-8504-abc7615c1d43/856191d6-dee9-53b1-8504-abc7615c1d43_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/8996bfb036d34293b2d1857ff56c8174/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981217%27 HTTP/1.1" 200 None
2026-03-24 22:47:57 [ayvens.be] INFO: Saving data for 1981217: {'created_time': 1774392477.219672, 'last_price_update_time': 1774392477.219682, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981217') HTTP/1.1" 204 0
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/9.jpg not downloaded yet
2026-03-24 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/10.jpg not downloaded yet
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009490590>
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F6f4799cb74f9419f8f9f1ba41b864831%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/10.jpg saved to cache
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b
2026-03-24 22:47:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b, skipping ID generation
2026-03-24 22:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with scrape type 1
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b sending to next pipeline
2026-03-24 22:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b, identifier: 1981219
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359950>
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/3.jpg saved to cache
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091402d0>
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/2.jpg saved to cache
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:57 [ayvens.be] INFO: Found listing with ID: 1981222
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981222%27 HTTP/1.1" 200 None
2026-03-24 22:47:57 [ayvens.be] INFO: Scrape type for 1981222: 1
2026-03-24 22:47:57 [ayvens.be] INFO: Extracting data for car ID: 1981222
2026-03-24 22:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222
2026-03-24 22:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with scrape type 1
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/1.jpg not downloaded yet
2026-03-24 22:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219
2026-03-24 22:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219
2026-03-24 22:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219 to the API
2026-03-24 22:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 61187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b/2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 872986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/6f4799cb74f9419f8f9f1ba41b864831/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981219%27 HTTP/1.1" 200 None
2026-03-24 22:47:58 [ayvens.be] INFO: Saving data for 1981219: {'created_time': 1774392478.182956, 'last_price_update_time': 1774392478.182965, 'auction_closing_time': 1774855800.0}
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981219') HTTP/1.1" 204 0
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/2.jpg not downloaded yet
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009614b10>
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/4.jpg saved to cache
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/3.jpg not downloaded yet
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009111e10>
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/1.jpg saved to cache
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c850>
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/5.jpg saved to cache
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/4.jpg not downloaded yet
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d01a90>
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/6.jpg saved to cache
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008327dd0>
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/7.jpg saved to cache
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/5.jpg not downloaded yet
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/6.jpg not downloaded yet
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bd310>
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/2.jpg saved to cache
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b7fd0>
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/1.jpg saved to cache
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/7.jpg not downloaded yet
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/8.jpg not downloaded yet
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091413d0>
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/4.jpg saved to cache
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872750>
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/8.jpg saved to cache
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835a750>
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/10.jpg saved to cache
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830a810>
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/3.jpg saved to cache
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/9.jpg not downloaded yet
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c8650>
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F2bde4a82c6f04f1a879146160f0a6222%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/9.jpg saved to cache
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453
2026-03-24 22:47:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453, skipping ID generation
2026-03-24 22:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with scrape type 1
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 sending to next pipeline
2026-03-24 22:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453, identifier: 1981220
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b296a90>
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/5.jpg saved to cache
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382c50>
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/7.jpg saved to cache
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/10.jpg not downloaded yet
2026-03-24 22:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220
2026-03-24 22:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220
2026-03-24 22:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220 to the API
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 63765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 838545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453/1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/2bde4a82c6f04f1a879146160f0a6222/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT 1.5 BLUEHDI 120 S&S STANDARD PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 120 S&S STANDARD PREMIUM',
 'vin': None,
 'year': 2023}
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981220%27 HTTP/1.1" 200 None
2026-03-24 22:48:00 [ayvens.be] INFO: Saving data for 1981220: {'created_time': 1774392480.091277, 'last_price_update_time': 1774392480.09129, 'auction_closing_time': 1774855800.0}
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981220') HTTP/1.1" 204 0
2026-03-24 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:00 [ayvens.be] INFO: Found listing with ID: 1981223
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981223%27 HTTP/1.1" 200 None
2026-03-24 22:48:00 [ayvens.be] INFO: Scrape type for 1981223: 1
2026-03-24 22:48:00 [ayvens.be] INFO: Extracting data for car ID: 1981223
2026-03-24 22:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223
2026-03-24 22:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb with scrape type 1
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/1.jpg not downloaded yet
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bc190>
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/6.jpg saved to cache
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/2.jpg not downloaded yet
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/3.jpg not downloaded yet
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873450>
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/10.jpg saved to cache
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/4.jpg not downloaded yet
2026-03-24 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/5.jpg not downloaded yet
2026-03-24 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/6.jpg not downloaded yet
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fa150>
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/8.jpg saved to cache
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310850>
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Ff3b852ffd401478f8e5de983380d6191%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/9.jpg saved to cache
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d63efcb-7417-5059-ac68-bf58c9cb6092
2026-03-24 22:48:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d63efcb-7417-5059-ac68-bf58c9cb6092, skipping ID generation
2026-03-24 22:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d63efcb-7417-5059-ac68-bf58c9cb6092 with scrape type 1
2026-03-24 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d63efcb-7417-5059-ac68-bf58c9cb6092 sending to next pipeline
2026-03-24 22:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d63efcb-7417-5059-ac68-bf58c9cb6092, identifier: 1981221
2026-03-24 22:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221
2026-03-24 22:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221
2026-03-24 22:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221 to the API
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9d63efcb-7417-5059-ac68-bf58c9cb6092',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 80974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d63efcb-7417-5059-ac68-bf58c9cb6092/9d63efcb-7417-5059-ac68-bf58c9cb6092_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/f3b852ffd401478f8e5de983380d6191/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981221%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [ayvens.be] INFO: Saving data for 1981221: {'created_time': 1774392481.056499, 'last_price_update_time': 1774392481.05651, 'auction_closing_time': 1774855800.0}
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981221') HTTP/1.1" 204 0
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/7.jpg not downloaded yet
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/8.jpg not downloaded yet
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c42d0>
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/2.jpg saved to cache
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094abd10>
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/1.jpg saved to cache
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7b50>
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/3.jpg saved to cache
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009154210>
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/4.jpg saved to cache
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4750>
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/5.jpg saved to cache
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/9.jpg not downloaded yet
2026-03-24 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/10.jpg not downloaded yet
2026-03-24 22:48:01 [ayvens.be] INFO: Found listing with ID: 1981224
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981224%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [ayvens.be] INFO: Scrape type for 1981224: 1
2026-03-24 22:48:01 [ayvens.be] INFO: Extracting data for car ID: 1981224
2026-03-24 22:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224
2026-03-24 22:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91167241-1ce0-532b-91ad-1de2768d8ed7 with scrape type 1
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/1.jpg not downloaded yet
2026-03-24 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/2.jpg not downloaded yet
2026-03-24 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/3.jpg not downloaded yet
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009868210>
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/7.jpg saved to cache
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/4.jpg not downloaded yet
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/5.jpg not downloaded yet
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/6.jpg not downloaded yet
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009008d90>
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/6.jpg saved to cache
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008371a90>
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/2.jpg saved to cache
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4690>
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/1.jpg saved to cache
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839ae50>
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/9.jpg saved to cache
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c7510>
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/3.jpg saved to cache
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967fb90>
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/8.jpg saved to cache
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ccf50>
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F0106dcacc2094ab99e1634dcd3d6926d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/10.jpg saved to cache
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064
2026-03-24 22:48:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064, skipping ID generation
2026-03-24 22:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with scrape type 1
2026-03-24 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 sending to next pipeline
2026-03-24 22:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064, identifier: 1981222
2026-03-24 22:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222
2026-03-24 22:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222
2026-03-24 22:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222 to the API
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3c8afef5-b3db-5cb5-89c6-a53c9ea23064',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 73652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c8afef5-b3db-5cb5-89c6-a53c9ea23064/3c8afef5-b3db-5cb5-89c6-a53c9ea23064_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 830221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/0106dcacc2094ab99e1634dcd3d6926d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981222%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [ayvens.be] INFO: Saving data for 1981222: {'created_time': 1774392483.082696, 'last_price_update_time': 1774392483.082705, 'auction_closing_time': 1774855800.0}
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981222') HTTP/1.1" 204 0
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/7.jpg not downloaded yet
2026-03-24 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/8.jpg not downloaded yet
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/9.jpg not downloaded yet
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/10.jpg not downloaded yet
2026-03-24 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:03 [ayvens.be] INFO: Found listing with ID: 1981225
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981225%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [ayvens.be] INFO: Scrape type for 1981225: 1
2026-03-24 22:48:03 [ayvens.be] INFO: Extracting data for car ID: 1981225
2026-03-24 22:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225
2026-03-24 22:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with scrape type 1
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/1.jpg not downloaded yet
2026-03-24 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/2.jpg not downloaded yet
2026-03-24 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009567090>
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/4.jpg saved to cache
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/3.jpg not downloaded yet
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/4.jpg not downloaded yet
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/5.jpg not downloaded yet
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938d350>
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/7.jpg saved to cache
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008380590>
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/5.jpg saved to cache
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963be90>
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/1.jpg saved to cache
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083377d0>
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/9.jpg saved to cache
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917ef10>
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/10.jpg saved to cache
2026-03-24 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382ad0>
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/6.jpg saved to cache
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff014749110>
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F0b00031ead274619a9117ae71bf850cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/8.jpg saved to cache
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb
2026-03-24 22:48:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d40f18b1-eb43-5300-84a5-8ae362c6f8eb, skipping ID generation
2026-03-24 22:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb with scrape type 1
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb sending to next pipeline
2026-03-24 22:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d40f18b1-eb43-5300-84a5-8ae362c6f8eb, identifier: 1981223
2026-03-24 22:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223
2026-03-24 22:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223
2026-03-24 22:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223 to the API
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd40f18b1-eb43-5300-84a5-8ae362c6f8eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 121909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d40f18b1-eb43-5300-84a5-8ae362c6f8eb/d40f18b1-eb43-5300-84a5-8ae362c6f8eb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/0b00031ead274619a9117ae71bf850cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981223%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [ayvens.be] INFO: Saving data for 1981223: {'created_time': 1774392484.637299, 'last_price_update_time': 1774392484.637309, 'auction_closing_time': 1774855800.0}
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981223') HTTP/1.1" 204 0
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/6.jpg not downloaded yet
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/7.jpg not downloaded yet
2026-03-24 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/8.jpg not downloaded yet
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/9.jpg not downloaded yet
2026-03-24 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/10.jpg not downloaded yet
2026-03-24 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:04 [ayvens.be] INFO: Found listing with ID: 1981226
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981226%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [ayvens.be] INFO: Scrape type for 1981226: 1
2026-03-24 22:48:04 [ayvens.be] INFO: Extracting data for car ID: 1981226
2026-03-24 22:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226
2026-03-24 22:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490c4e0d-78be-583b-a19e-db898b47043b with scrape type 1
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/1.jpg not downloaded yet
2026-03-24 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/2.jpg not downloaded yet
2026-03-24 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/3.jpg not downloaded yet
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917ef10>
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/4.jpg saved to cache
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/4.jpg not downloaded yet
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b010>
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/7.jpg saved to cache
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/5.jpg not downloaded yet
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/6.jpg not downloaded yet
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144bd0>
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/5.jpg saved to cache
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce110>
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/2.jpg saved to cache
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094921d0>
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/3.jpg saved to cache
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441410>
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/6.jpg saved to cache
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4290>
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/9.jpg saved to cache
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334d10>
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/8.jpg saved to cache
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/7.jpg not downloaded yet
2026-03-24 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/8.jpg not downloaded yet
2026-03-24 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/9.jpg not downloaded yet
2026-03-24 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/10.jpg not downloaded yet
2026-03-24 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:05 [ayvens.be] INFO: Found listing with ID: 1978467
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978467%27 HTTP/1.1" 200 None
2026-03-24 22:48:05 [ayvens.be] INFO: Scrape type for 1978467: 2
2026-03-24 22:48:05 [ayvens.be] INFO: Extracting data for car ID: 1978467
2026-03-24 22:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467
2026-03-24 22:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with scrape type 2
2026-03-24 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with scrape type 2
2026-03-24 22:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab, identifier: 1978467
2026-03-24 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467
2026-03-24 22:48:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467
2026-03-24 22:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467 to the API
2026-03-24 22:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'MOONDUST SILVER',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '2d0e3722-8fdf-5a4b-bc93-12c345f69aab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS - 2018',
 'odometer': 91431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS - 2018 1.0 EcoBoost ST-Line Business Winter',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost ST-Line Business Winter',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978467%27 HTTP/1.1" 200 None
2026-03-24 22:48:06 [ayvens.be] INFO: Saving data for 1978467: {'auction_closing_time': 1774854000.0, 'created_time': 1774305925.581173, 'last_price_update_time': 1774392486.156404}
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978467') HTTP/1.1" 204 0
2026-03-24 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:06 [ayvens.be] INFO: Found listing with ID: 1978468
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978468%27 HTTP/1.1" 200 None
2026-03-24 22:48:06 [ayvens.be] INFO: Scrape type for 1978468: 2
2026-03-24 22:48:06 [ayvens.be] INFO: Extracting data for car ID: 1978468
2026-03-24 22:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468
2026-03-24 22:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with scrape type 2
2026-03-24 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with scrape type 2
2026-03-24 22:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c, identifier: 1978468
2026-03-24 22:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468
2026-03-24 22:48:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468
2026-03-24 22:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468 to the API
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLEU BOUTASQUE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fcbbd5ce-3466-53ba-b6a6-629a539f7f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 - 2017',
 'odometer': 112390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 - 2017 1.2 PureTech Allure (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.2 PureTech Allure (EU6.2)',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978468%27 HTTP/1.1" 200 None
2026-03-24 22:48:06 [ayvens.be] INFO: Saving data for 1978468: {'auction_closing_time': 1774854000.0, 'created_time': 1774305929.210301, 'last_price_update_time': 1774392486.635305}
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978468') HTTP/1.1" 204 0
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aecf6d0>
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe450e5ce870b47d0a667f1bdca08607f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/10.jpg saved to cache
2026-03-24 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91167241-1ce0-532b-91ad-1de2768d8ed7
2026-03-24 22:48:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91167241-1ce0-532b-91ad-1de2768d8ed7, skipping ID generation
2026-03-24 22:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91167241-1ce0-532b-91ad-1de2768d8ed7 with scrape type 1
2026-03-24 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91167241-1ce0-532b-91ad-1de2768d8ed7 sending to next pipeline
2026-03-24 22:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91167241-1ce0-532b-91ad-1de2768d8ed7, identifier: 1981224
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938ce10>
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/4.jpg saved to cache
2026-03-24 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009470350>
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/1.jpg saved to cache
2026-03-24 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917f490>
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/7.jpg saved to cache
2026-03-24 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131250>
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/5.jpg saved to cache
2026-03-24 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:07 [ayvens.be] INFO: Found listing with ID: 1978469
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978469%27 HTTP/1.1" 200 None
2026-03-24 22:48:07 [ayvens.be] INFO: Scrape type for 1978469: 2
2026-03-24 22:48:07 [ayvens.be] INFO: Extracting data for car ID: 1978469
2026-03-24 22:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469
2026-03-24 22:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79cc47e-5142-5c31-ba8a-5fe779924ecb with scrape type 2
2026-03-24 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f79cc47e-5142-5c31-ba8a-5fe779924ecb with scrape type 2
2026-03-24 22:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f79cc47e-5142-5c31-ba8a-5fe779924ecb, identifier: 1978469
2026-03-24 22:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224
2026-03-24 22:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224
2026-03-24 22:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224 to the API
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '91167241-1ce0-532b-91ad-1de2768d8ed7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 97086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 902207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91167241-1ce0-532b-91ad-1de2768d8ed7/91167241-1ce0-532b-91ad-1de2768d8ed7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e450e5ce870b47d0a667f1bdca08607f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI 81KW AMBITION',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW AMBITION',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981224%27 HTTP/1.1" 200 None
2026-03-24 22:48:07 [ayvens.be] INFO: Saving data for 1981224: {'created_time': 1774392487.685204, 'last_price_update_time': 1774392487.685213, 'auction_closing_time': 1774855800.0}
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981224') HTTP/1.1" 204 0
2026-03-24 22:48:07 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -2 pages/min), scraped 92 items (at 35 items/min)
2026-03-24 22:48:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-24 22:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469
2026-03-24 22:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469
2026-03-24 22:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469 to the API
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f79cc47e-5142-5c31-ba8a-5fe779924ecb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SEDAN DIESEL - 2020',
 'odometer': 57850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SEDAN DIESEL - 2020 35 TDi S line S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi S line S tronic',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978469%27 HTTP/1.1" 200 None
2026-03-24 22:48:07 [ayvens.be] INFO: Saving data for 1978469: {'auction_closing_time': 1774854000.0, 'created_time': 1774305928.180435, 'last_price_update_time': 1774392487.9713}
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978469') HTTP/1.1" 204 0
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643050>
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/6.jpg saved to cache
2026-03-24 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009870910>
2026-03-24 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/3.jpg saved to cache
2026-03-24 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008346d10>
2026-03-24 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/2.jpg saved to cache
2026-03-24 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:08 [ayvens.be] INFO: Found listing with ID: 1978470
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978470%27 HTTP/1.1" 200 None
2026-03-24 22:48:08 [ayvens.be] INFO: Scrape type for 1978470: 2
2026-03-24 22:48:08 [ayvens.be] INFO: Extracting data for car ID: 1978470
2026-03-24 22:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470
2026-03-24 22:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with scrape type 2
2026-03-24 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with scrape type 2
2026-03-24 22:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301, identifier: 1978470
2026-03-24 22:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470
2026-03-24 22:48:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470
2026-03-24 22:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470 to the API
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '30fcdcad-20a5-54b7-a6bd-ebd58bdc4301',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DUCATO 35 FOURGON LWB DSL - 20',
 'odometer': 116151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seats_number': None,
 'seller_name': None,
 'title': 'FIAT DUCATO 35 FOURGON LWB DSL - 20 2.0 Mjet L3H2 (EU6)',
 'transmission': 'manual',
 'trim': '2.0 Mjet L3H2 (EU6)',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978470%27 HTTP/1.1" 200 None
2026-03-24 22:48:08 [ayvens.be] INFO: Saving data for 1978470: {'auction_closing_time': 1774854000.0, 'created_time': 1774305930.007406, 'last_price_update_time': 1774392488.651244}
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978470') HTTP/1.1" 204 0
2026-03-24 22:48:08 [ayvens.be] INFO: Found listing with ID: 1978471
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978471%27 HTTP/1.1" 200 None
2026-03-24 22:48:08 [ayvens.be] INFO: Scrape type for 1978471: 2
2026-03-24 22:48:08 [ayvens.be] INFO: Extracting data for car ID: 1978471
2026-03-24 22:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471
2026-03-24 22:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb8849a-6dd2-5d69-9764-d04ef9128f8f with scrape type 2
2026-03-24 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbb8849a-6dd2-5d69-9764-d04ef9128f8f with scrape type 2
2026-03-24 22:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dbb8849a-6dd2-5d69-9764-d04ef9128f8f, identifier: 1978471
2026-03-24 22:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471
2026-03-24 22:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471
2026-03-24 22:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471 to the API
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dbb8849a-6dd2-5d69-9764-d04ef9128f8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT - 2020',
 'odometer': 70409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT - 2020 35 TFSI S tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S tronic',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978471%27 HTTP/1.1" 200 None
2026-03-24 22:48:09 [ayvens.be] INFO: Saving data for 1978471: {'auction_closing_time': 1774854000.0, 'created_time': 1774305931.892437, 'last_price_update_time': 1774392489.050113}
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978471') HTTP/1.1" 204 0
2026-03-24 22:48:09 [ayvens.be] INFO: Found listing with ID: 1978472
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978472%27 HTTP/1.1" 200 None
2026-03-24 22:48:09 [ayvens.be] INFO: Scrape type for 1978472: 2
2026-03-24 22:48:09 [ayvens.be] INFO: Extracting data for car ID: 1978472
2026-03-24 22:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472
2026-03-24 22:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 809bf565-ad99-5a94-b968-77e20618ac73 with scrape type 2
2026-03-24 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 809bf565-ad99-5a94-b968-77e20618ac73 with scrape type 2
2026-03-24 22:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 809bf565-ad99-5a94-b968-77e20618ac73, identifier: 1978472
2026-03-24 22:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472
2026-03-24 22:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472
2026-03-24 22:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472 to the API
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '809bf565-ad99-5a94-b968-77e20618ac73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 47854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 CRDI 136 MHEV BUSINESS LINE DCT',
 'transmission': 'automatic',
 'trim': '1.6 CRDI 136 MHEV BUSINESS LINE DCT',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978472%27 HTTP/1.1" 200 None
2026-03-24 22:48:09 [ayvens.be] INFO: Saving data for 1978472: {'auction_closing_time': 1774854000.0, 'created_time': 1774305933.047169, 'last_price_update_time': 1774392489.448762}
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978472') HTTP/1.1" 204 0
2026-03-24 22:48:09 [ayvens.be] INFO: Found listing with ID: 1978473
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978473%27 HTTP/1.1" 200 None
2026-03-24 22:48:09 [ayvens.be] INFO: Scrape type for 1978473: 2
2026-03-24 22:48:09 [ayvens.be] INFO: Extracting data for car ID: 1978473
2026-03-24 22:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473
2026-03-24 22:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with scrape type 2
2026-03-24 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with scrape type 2
2026-03-24 22:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5, identifier: 1978473
2026-03-24 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473
2026-03-24 22:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473
2026-03-24 22:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473 to the API
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 65370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978473%27 HTTP/1.1" 200 None
2026-03-24 22:48:09 [ayvens.be] INFO: Saving data for 1978473: {'auction_closing_time': 1774854000.0, 'created_time': 1774305934.763122, 'last_price_update_time': 1774392489.825696}
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978473') HTTP/1.1" 204 0
2026-03-24 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:09 [ayvens.be] INFO: Found listing with ID: 1978474
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978474%27 HTTP/1.1" 200 None
2026-03-24 22:48:09 [ayvens.be] INFO: Scrape type for 1978474: 2
2026-03-24 22:48:09 [ayvens.be] INFO: Extracting data for car ID: 1978474
2026-03-24 22:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474
2026-03-24 22:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 896ef9b3-abd7-55d8-baba-f01b99006ee0 with scrape type 2
2026-03-24 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 896ef9b3-abd7-55d8-baba-f01b99006ee0 with scrape type 2
2026-03-24 22:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 896ef9b3-abd7-55d8-baba-f01b99006ee0, identifier: 1978474
2026-03-24 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474
2026-03-24 22:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474
2026-03-24 22:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474 to the API
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '896ef9b3-abd7-55d8-baba-f01b99006ee0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 SPORTBACK',
 'odometer': 210743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 SPORTBACK 2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978474%27 HTTP/1.1" 200 None
2026-03-24 22:48:10 [ayvens.be] INFO: Saving data for 1978474: {'auction_closing_time': 1774854000.0, 'created_time': 1774305936.608962, 'last_price_update_time': 1774392490.208044}
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978474') HTTP/1.1" 204 0
2026-03-24 22:48:10 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-24 22:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b3490>
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/5.jpg saved to cache
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed8650>
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/8.jpg saved to cache
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2b490>
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/10.jpg saved to cache
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009154b90>
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/2.jpg saved to cache
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013ed0>
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F722b893490c44ade9bf431276589f248%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/9.jpg saved to cache
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0
2026-03-24 22:48:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 107c88f6-ede3-5766-9ff9-509e0ef77cd0, skipping ID generation
2026-03-24 22:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with scrape type 1
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0 sending to next pipeline
2026-03-24 22:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 107c88f6-ede3-5766-9ff9-509e0ef77cd0, identifier: 1981225
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b5290>
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/4.jpg saved to cache
2026-03-24 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1210>
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/3.jpg saved to cache
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225
2026-03-24 22:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225
2026-03-24 22:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225 to the API
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '107c88f6-ede3-5766-9ff9-509e0ef77cd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107c88f6-ede3-5766-9ff9-509e0ef77cd0/107c88f6-ede3-5766-9ff9-509e0ef77cd0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/722b893490c44ade9bf431276589f248/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 2.0 XDRIVE20I AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE20I AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981225%27 HTTP/1.1" 200 None
2026-03-24 22:48:11 [ayvens.be] INFO: Saving data for 1981225: {'created_time': 1774392491.442542, 'last_price_update_time': 1774392491.442553, 'auction_closing_time': 1774855800.0}
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981225') HTTP/1.1" 204 0
2026-03-24 22:48:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083436d0>
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/1.jpg saved to cache
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119550>
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/7.jpg saved to cache
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb31d0>
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/8.jpg saved to cache
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b7ce8d0>
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/9.jpg saved to cache
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb7d0>
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/6.jpg saved to cache
2026-03-24 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd210>
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wk%252F0f18702ae07c4aa1b8edaf2078aa6900%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/10.jpg saved to cache
2026-03-24 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 490c4e0d-78be-583b-a19e-db898b47043b
2026-03-24 22:48:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 490c4e0d-78be-583b-a19e-db898b47043b, skipping ID generation
2026-03-24 22:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490c4e0d-78be-583b-a19e-db898b47043b with scrape type 1
2026-03-24 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 490c4e0d-78be-583b-a19e-db898b47043b sending to next pipeline
2026-03-24 22:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 490c4e0d-78be-583b-a19e-db898b47043b, identifier: 1981226
2026-03-24 22:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226
2026-03-24 22:48:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226
2026-03-24 22:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226 to the API
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '490c4e0d-78be-583b-a19e-db898b47043b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Passat',
 'odometer': 218512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 880688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 838225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490c4e0d-78be-583b-a19e-db898b47043b/490c4e0d-78be-583b-a19e-db898b47043b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wk/0f18702ae07c4aa1b8edaf2078aa6900/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Passat 1.6 CR TDi Comfortline Business DSG STOCK',
 'transmission': 'automatic',
 'trim': '1.6 CR TDi Comfortline Business DSG STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981226%27 HTTP/1.1" 200 None
2026-03-24 22:48:12 [ayvens.be] INFO: Saving data for 1981226: {'created_time': 1774392492.46014, 'last_price_update_time': 1774392492.460153, 'auction_closing_time': 1774855800.0}
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981226') HTTP/1.1" 204 0
2026-03-24 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:48:17 [ayvens.be] INFO: Found listing with ID: 1978475
2026-03-24 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978475%27 HTTP/1.1" 200 None
2026-03-24 22:48:17 [ayvens.be] INFO: Scrape type for 1978475: 2
2026-03-24 22:48:17 [ayvens.be] INFO: Extracting data for car ID: 1978475
2026-03-24 22:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475
2026-03-24 22:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606ca47f-f13e-5794-8919-5c666f0653e3 with scrape type 2
2026-03-24 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606ca47f-f13e-5794-8919-5c666f0653e3 with scrape type 2
2026-03-24 22:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 606ca47f-f13e-5794-8919-5c666f0653e3, identifier: 1978475
2026-03-24 22:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475
2026-03-24 22:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475
2026-03-24 22:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475 to the API
2026-03-24 22:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '606ca47f-f13e-5794-8919-5c666f0653e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C4',
 'odometer': 148256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C4 1.5 BLUEHDI 130 S&S SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S SHINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978475%27 HTTP/1.1" 200 None
2026-03-24 22:48:17 [ayvens.be] INFO: Saving data for 1978475: {'auction_closing_time': 1774854000.0, 'created_time': 1774305938.424594, 'last_price_update_time': 1774392497.913405}
2026-03-24 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978475') HTTP/1.1" 204 0
2026-03-24 22:48:18 [ayvens.be] INFO: Found listing with ID: 1978476
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978476%27 HTTP/1.1" 200 None
2026-03-24 22:48:18 [ayvens.be] INFO: Scrape type for 1978476: 2
2026-03-24 22:48:18 [ayvens.be] INFO: Extracting data for car ID: 1978476
2026-03-24 22:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476
2026-03-24 22:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8303c6eb-cc26-557c-b7c8-1758d5f61559 with scrape type 2
2026-03-24 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8303c6eb-cc26-557c-b7c8-1758d5f61559 with scrape type 2
2026-03-24 22:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8303c6eb-cc26-557c-b7c8-1758d5f61559, identifier: 1978476
2026-03-24 22:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476
2026-03-24 22:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476
2026-03-24 22:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476 to the API
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '8303c6eb-cc26-557c-b7c8-1758d5f61559',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 252773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978476%27 HTTP/1.1" 200 None
2026-03-24 22:48:18 [ayvens.be] INFO: Saving data for 1978476: {'auction_closing_time': 1774854000.0, 'created_time': 1774305940.149589, 'last_price_update_time': 1774392498.369124}
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978476') HTTP/1.1" 204 0
2026-03-24 22:48:18 [ayvens.be] INFO: Found listing with ID: 1978477
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978477%27 HTTP/1.1" 200 None
2026-03-24 22:48:18 [ayvens.be] INFO: Scrape type for 1978477: 2
2026-03-24 22:48:18 [ayvens.be] INFO: Extracting data for car ID: 1978477
2026-03-24 22:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477
2026-03-24 22:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10caeb8-09ba-5c58-a982-0d21ea9ebaea with scrape type 2
2026-03-24 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f10caeb8-09ba-5c58-a982-0d21ea9ebaea with scrape type 2
2026-03-24 22:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f10caeb8-09ba-5c58-a982-0d21ea9ebaea, identifier: 1978477
2026-03-24 22:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477
2026-03-24 22:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477
2026-03-24 22:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477 to the API
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f10caeb8-09ba-5c58-a982-0d21ea9ebaea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 40529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978477%27 HTTP/1.1" 200 None
2026-03-24 22:48:18 [ayvens.be] INFO: Saving data for 1978477: {'auction_closing_time': 1774854000.0, 'created_time': 1774305941.620308, 'last_price_update_time': 1774392498.747154}
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978477') HTTP/1.1" 204 0
2026-03-24 22:48:18 [ayvens.be] INFO: Found listing with ID: 1978478
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978478%27 HTTP/1.1" 200 None
2026-03-24 22:48:18 [ayvens.be] INFO: Scrape type for 1978478: 2
2026-03-24 22:48:18 [ayvens.be] INFO: Extracting data for car ID: 1978478
2026-03-24 22:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478
2026-03-24 22:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0a9dda7-405b-5886-9d69-96d02d20f488 with scrape type 2
2026-03-24 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0a9dda7-405b-5886-9d69-96d02d20f488 with scrape type 2
2026-03-24 22:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c0a9dda7-405b-5886-9d69-96d02d20f488, identifier: 1978478
2026-03-24 22:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478
2026-03-24 22:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478
2026-03-24 22:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478 to the API
2026-03-24 22:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0a9dda7-405b-5886-9d69-96d02d20f488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT',
 'odometer': 87601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT 2.0 TDI 35 S TRONIC BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 S TRONIC BUSINESS EDITION',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978478%27 HTTP/1.1" 200 None
2026-03-24 22:48:19 [ayvens.be] INFO: Saving data for 1978478: {'auction_closing_time': 1774854000.0, 'created_time': 1774305943.707778, 'last_price_update_time': 1774392499.133591}
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978478') HTTP/1.1" 204 0
2026-03-24 22:48:19 [ayvens.be] INFO: Found listing with ID: 1978479
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978479%27 HTTP/1.1" 200 None
2026-03-24 22:48:19 [ayvens.be] INFO: Scrape type for 1978479: 2
2026-03-24 22:48:19 [ayvens.be] INFO: Extracting data for car ID: 1978479
2026-03-24 22:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479
2026-03-24 22:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb7fe50-46a0-518d-a563-078b2e772404 with scrape type 2
2026-03-24 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfb7fe50-46a0-518d-a563-078b2e772404 with scrape type 2
2026-03-24 22:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cfb7fe50-46a0-518d-a563-078b2e772404, identifier: 1978479
2026-03-24 22:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479
2026-03-24 22:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479
2026-03-24 22:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479 to the API
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cfb7fe50-46a0-518d-a563-078b2e772404',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 121907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978479%27 HTTP/1.1" 200 None
2026-03-24 22:48:19 [ayvens.be] INFO: Saving data for 1978479: {'auction_closing_time': 1774854000.0, 'created_time': 1774305945.941173, 'last_price_update_time': 1774392499.510998}
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978479') HTTP/1.1" 204 0
2026-03-24 22:48:19 [ayvens.be] INFO: Found listing with ID: 1978480
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978480%27 HTTP/1.1" 200 None
2026-03-24 22:48:19 [ayvens.be] INFO: Scrape type for 1978480: 2
2026-03-24 22:48:19 [ayvens.be] INFO: Extracting data for car ID: 1978480
2026-03-24 22:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480
2026-03-24 22:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f5599f-eec1-560c-89df-9f0e076c42f2 with scrape type 2
2026-03-24 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f5599f-eec1-560c-89df-9f0e076c42f2 with scrape type 2
2026-03-24 22:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 43f5599f-eec1-560c-89df-9f0e076c42f2, identifier: 1978480
2026-03-24 22:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480
2026-03-24 22:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480
2026-03-24 22:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480 to the API
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '43f5599f-eec1-560c-89df-9f0e076c42f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 61067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978480%27 HTTP/1.1" 200 None
2026-03-24 22:48:19 [ayvens.be] INFO: Saving data for 1978480: {'auction_closing_time': 1774854000.0, 'created_time': 1774305948.115122, 'last_price_update_time': 1774392499.97768}
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978480') HTTP/1.1" 204 0
2026-03-24 22:48:19 [ayvens.be] INFO: Found listing with ID: 1978481
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978481%27 HTTP/1.1" 200 None
2026-03-24 22:48:20 [ayvens.be] INFO: Scrape type for 1978481: 2
2026-03-24 22:48:20 [ayvens.be] INFO: Extracting data for car ID: 1978481
2026-03-24 22:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481
2026-03-24 22:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with scrape type 2
2026-03-24 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with scrape type 2
2026-03-24 22:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928, identifier: 1978481
2026-03-24 22:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481
2026-03-24 22:48:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481
2026-03-24 22:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481 to the API
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '36c3b6e2-0c48-590c-ba3d-0250e1b9d928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 211793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Grand Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Grand Confort',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978481%27 HTTP/1.1" 200 None
2026-03-24 22:48:20 [ayvens.be] INFO: Saving data for 1978481: {'auction_closing_time': 1774854000.0, 'created_time': 1774305949.317347, 'last_price_update_time': 1774392500.356126}
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978481') HTTP/1.1" 204 0
2026-03-24 22:48:20 [ayvens.be] INFO: Found listing with ID: 1978482
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978482%27 HTTP/1.1" 200 None
2026-03-24 22:48:20 [ayvens.be] INFO: Scrape type for 1978482: 2
2026-03-24 22:48:20 [ayvens.be] INFO: Extracting data for car ID: 1978482
2026-03-24 22:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482
2026-03-24 22:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6be95bf-6e0a-5d91-b5bd-437f53dde13f with scrape type 2
2026-03-24 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6be95bf-6e0a-5d91-b5bd-437f53dde13f with scrape type 2
2026-03-24 22:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e6be95bf-6e0a-5d91-b5bd-437f53dde13f, identifier: 1978482
2026-03-24 22:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482
2026-03-24 22:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482
2026-03-24 22:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482 to the API
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e6be95bf-6e0a-5d91-b5bd-437f53dde13f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 166861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978482%27 HTTP/1.1" 200 None
2026-03-24 22:48:20 [ayvens.be] INFO: Saving data for 1978482: {'auction_closing_time': 1774854000.0, 'created_time': 1774305952.067454, 'last_price_update_time': 1774392500.733401}
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978482') HTTP/1.1" 204 0
2026-03-24 22:48:20 [ayvens.be] INFO: Found listing with ID: 1978483
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978483%27 HTTP/1.1" 200 None
2026-03-24 22:48:20 [ayvens.be] INFO: Scrape type for 1978483: 2
2026-03-24 22:48:20 [ayvens.be] INFO: Extracting data for car ID: 1978483
2026-03-24 22:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483
2026-03-24 22:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51d90862-96e7-5f12-9a7a-52f62015120b with scrape type 2
2026-03-24 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51d90862-96e7-5f12-9a7a-52f62015120b with scrape type 2
2026-03-24 22:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 51d90862-96e7-5f12-9a7a-52f62015120b, identifier: 1978483
2026-03-24 22:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483
2026-03-24 22:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483
2026-03-24 22:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483 to the API
2026-03-24 22:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '51d90862-96e7-5f12-9a7a-52f62015120b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 173398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978483%27 HTTP/1.1" 200 None
2026-03-24 22:48:21 [ayvens.be] INFO: Saving data for 1978483: {'auction_closing_time': 1774854000.0, 'created_time': 1774305953.430147, 'last_price_update_time': 1774392501.115911}
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978483') HTTP/1.1" 204 0
2026-03-24 22:48:21 [ayvens.be] INFO: Found listing with ID: 1978484
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978484%27 HTTP/1.1" 200 None
2026-03-24 22:48:21 [ayvens.be] INFO: Scrape type for 1978484: 2
2026-03-24 22:48:21 [ayvens.be] INFO: Extracting data for car ID: 1978484
2026-03-24 22:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484
2026-03-24 22:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21561285-2e69-59fd-90f0-2bc2813b1502 with scrape type 2
2026-03-24 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21561285-2e69-59fd-90f0-2bc2813b1502 with scrape type 2
2026-03-24 22:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 21561285-2e69-59fd-90f0-2bc2813b1502, identifier: 1978484
2026-03-24 22:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484
2026-03-24 22:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484
2026-03-24 22:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484 to the API
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '21561285-2e69-59fd-90f0-2bc2813b1502',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 158748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER 1.5 BLUEHDI 75KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S ACTIVE',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978484%27 HTTP/1.1" 200 None
2026-03-24 22:48:21 [ayvens.be] INFO: Saving data for 1978484: {'auction_closing_time': 1774854000.0, 'created_time': 1774305955.090734, 'last_price_update_time': 1774392501.480299}
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978484') HTTP/1.1" 204 0
2026-03-24 22:48:21 [ayvens.be] INFO: Found listing with ID: 1978485
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978485%27 HTTP/1.1" 200 None
2026-03-24 22:48:21 [ayvens.be] INFO: Scrape type for 1978485: 2
2026-03-24 22:48:21 [ayvens.be] INFO: Extracting data for car ID: 1978485
2026-03-24 22:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485
2026-03-24 22:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b98d3af-5ca9-5501-8411-b1ccc14a16db with scrape type 2
2026-03-24 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b98d3af-5ca9-5501-8411-b1ccc14a16db with scrape type 2
2026-03-24 22:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b98d3af-5ca9-5501-8411-b1ccc14a16db, identifier: 1978485
2026-03-24 22:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485
2026-03-24 22:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485
2026-03-24 22:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485 to the API
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '2b98d3af-5ca9-5501-8411-b1ccc14a16db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 65651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978485%27 HTTP/1.1" 200 None
2026-03-24 22:48:21 [ayvens.be] INFO: Saving data for 1978485: {'auction_closing_time': 1774854000.0, 'created_time': 1774306012.091532, 'last_price_update_time': 1774392501.859114}
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978485') HTTP/1.1" 204 0
2026-03-24 22:48:21 [ayvens.be] INFO: Found listing with ID: 1978486
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978486%27 HTTP/1.1" 200 None
2026-03-24 22:48:21 [ayvens.be] INFO: Scrape type for 1978486: 2
2026-03-24 22:48:21 [ayvens.be] INFO: Extracting data for car ID: 1978486
2026-03-24 22:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486
2026-03-24 22:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with scrape type 2
2026-03-24 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with scrape type 2
2026-03-24 22:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c, identifier: 1978486
2026-03-24 22:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486
2026-03-24 22:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486
2026-03-24 22:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486 to the API
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '80e3f8c3-b697-5f49-bf6f-69f4cccef89c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 45712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978486%27 HTTP/1.1" 200 None
2026-03-24 22:48:22 [ayvens.be] INFO: Saving data for 1978486: {'auction_closing_time': 1774854000.0, 'created_time': 1774306009.399741, 'last_price_update_time': 1774392502.247401}
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978486') HTTP/1.1" 204 0
2026-03-24 22:48:22 [ayvens.be] INFO: Found listing with ID: 1978487
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978487%27 HTTP/1.1" 200 None
2026-03-24 22:48:22 [ayvens.be] INFO: Scrape type for 1978487: 2
2026-03-24 22:48:22 [ayvens.be] INFO: Extracting data for car ID: 1978487
2026-03-24 22:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487
2026-03-24 22:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with scrape type 2
2026-03-24 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with scrape type 2
2026-03-24 22:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33674112-cc7a-512a-a6d5-c1ed38fe95c9, identifier: 1978487
2026-03-24 22:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487
2026-03-24 22:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487
2026-03-24 22:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487 to the API
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '33674112-cc7a-512a-a6d5-c1ed38fe95c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'GRAND TOURNEO CONNECT',
 'odometer': 181137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD GRAND TOURNEO CONNECT 1.5 TDCI 88KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 TDCI 88KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978487%27 HTTP/1.1" 200 None
2026-03-24 22:48:22 [ayvens.be] INFO: Saving data for 1978487: {'auction_closing_time': 1774854000.0, 'created_time': 1774306010.505855, 'last_price_update_time': 1774392502.724597}
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978487') HTTP/1.1" 204 0
2026-03-24 22:48:22 [ayvens.be] INFO: Found listing with ID: 1978488
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978488%27 HTTP/1.1" 200 None
2026-03-24 22:48:22 [ayvens.be] INFO: Scrape type for 1978488: 2
2026-03-24 22:48:22 [ayvens.be] INFO: Extracting data for car ID: 1978488
2026-03-24 22:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488
2026-03-24 22:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 566d6efa-4328-52e0-adc7-a57383e86ce1 with scrape type 2
2026-03-24 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 566d6efa-4328-52e0-adc7-a57383e86ce1 with scrape type 2
2026-03-24 22:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 566d6efa-4328-52e0-adc7-a57383e86ce1, identifier: 1978488
2026-03-24 22:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488
2026-03-24 22:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488
2026-03-24 22:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488 to the API
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '566d6efa-4328-52e0-adc7-a57383e86ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 92937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978488%27 HTTP/1.1" 200 None
2026-03-24 22:48:23 [ayvens.be] INFO: Saving data for 1978488: {'auction_closing_time': 1774854000.0, 'created_time': 1774306008.670182, 'last_price_update_time': 1774392503.085379}
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978488') HTTP/1.1" 204 0
2026-03-24 22:48:23 [ayvens.be] INFO: Found listing with ID: 1978489
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978489%27 HTTP/1.1" 200 None
2026-03-24 22:48:23 [ayvens.be] INFO: Scrape type for 1978489: 2
2026-03-24 22:48:23 [ayvens.be] INFO: Extracting data for car ID: 1978489
2026-03-24 22:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489
2026-03-24 22:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222e6fe1-a081-58dd-a757-065567ce6ac2 with scrape type 2
2026-03-24 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 222e6fe1-a081-58dd-a757-065567ce6ac2 with scrape type 2
2026-03-24 22:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 222e6fe1-a081-58dd-a757-065567ce6ac2, identifier: 1978489
2026-03-24 22:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489
2026-03-24 22:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489
2026-03-24 22:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489 to the API
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '222e6fe1-a081-58dd-a757-065567ce6ac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA SPORTS TOURER DIESEL - 2',
 'odometer': 141412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA SPORTS TOURER DIESEL - 2 1.5 Turbo D Edition S-S',
 'transmission': 'manual',
 'trim': '1.5 Turbo D Edition S-S',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978489%27 HTTP/1.1" 200 None
2026-03-24 22:48:23 [ayvens.be] INFO: Saving data for 1978489: {'auction_closing_time': 1774854000.0, 'created_time': 1774306002.407456, 'last_price_update_time': 1774392503.548343}
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978489') HTTP/1.1" 204 0
2026-03-24 22:48:23 [ayvens.be] INFO: Found listing with ID: 1978490
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978490%27 HTTP/1.1" 200 None
2026-03-24 22:48:23 [ayvens.be] INFO: Scrape type for 1978490: 2
2026-03-24 22:48:23 [ayvens.be] INFO: Extracting data for car ID: 1978490
2026-03-24 22:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490
2026-03-24 22:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with scrape type 2
2026-03-24 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with scrape type 2
2026-03-24 22:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6, identifier: 1978490
2026-03-24 22:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490
2026-03-24 22:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490
2026-03-24 22:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490 to the API
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA SPORTS TOURER',
 'odometer': 87815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA SPORTS TOURER 1.5 TURBO D 90KW S-S BUSINESS ELEGANCE',
 'transmission': 'manual',
 'trim': '1.5 TURBO D 90KW S-S BUSINESS ELEGANCE',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978490%27 HTTP/1.1" 200 None
2026-03-24 22:48:24 [ayvens.be] INFO: Saving data for 1978490: {'auction_closing_time': 1774854000.0, 'created_time': 1774306001.139824, 'last_price_update_time': 1774392504.073221}
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978490') HTTP/1.1" 204 0
2026-03-24 22:48:24 [ayvens.be] INFO: Found listing with ID: 1978491
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978491%27 HTTP/1.1" 200 None
2026-03-24 22:48:24 [ayvens.be] INFO: Scrape type for 1978491: 2
2026-03-24 22:48:24 [ayvens.be] INFO: Extracting data for car ID: 1978491
2026-03-24 22:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491
2026-03-24 22:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 785f66e5-e9cb-545f-9a3e-df3ed0688872 with scrape type 2
2026-03-24 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 785f66e5-e9cb-545f-9a3e-df3ed0688872 with scrape type 2
2026-03-24 22:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 785f66e5-e9cb-545f-9a3e-df3ed0688872, identifier: 1978491
2026-03-24 22:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491
2026-03-24 22:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491
2026-03-24 22:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491 to the API
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '785f66e5-e9cb-545f-9a3e-df3ed0688872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 40369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978491%27 HTTP/1.1" 200 None
2026-03-24 22:48:24 [ayvens.be] INFO: Saving data for 1978491: {'auction_closing_time': 1774854000.0, 'created_time': 1774305998.944648, 'last_price_update_time': 1774392504.443969}
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978491') HTTP/1.1" 204 0
2026-03-24 22:48:24 [ayvens.be] INFO: Found listing with ID: 1978492
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978492%27 HTTP/1.1" 200 None
2026-03-24 22:48:24 [ayvens.be] INFO: Scrape type for 1978492: 2
2026-03-24 22:48:24 [ayvens.be] INFO: Extracting data for car ID: 1978492
2026-03-24 22:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492
2026-03-24 22:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with scrape type 2
2026-03-24 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with scrape type 2
2026-03-24 22:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1, identifier: 1978492
2026-03-24 22:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492
2026-03-24 22:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492
2026-03-24 22:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492 to the API
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '36c1d133-eb00-5228-a9ff-4bc35b8ef9d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 112992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2023}
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978492%27 HTTP/1.1" 200 None
2026-03-24 22:48:24 [ayvens.be] INFO: Saving data for 1978492: {'auction_closing_time': 1774854000.0, 'created_time': 1774305964.996659, 'last_price_update_time': 1774392504.824094}
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978492') HTTP/1.1" 204 0
2026-03-24 22:48:24 [ayvens.be] INFO: Found listing with ID: 1978493
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978493%27 HTTP/1.1" 200 None
2026-03-24 22:48:24 [ayvens.be] INFO: Scrape type for 1978493: 2
2026-03-24 22:48:24 [ayvens.be] INFO: Extracting data for car ID: 1978493
2026-03-24 22:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493
2026-03-24 22:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55067381-fc8f-534d-b377-5c6ce1942d59 with scrape type 2
2026-03-24 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55067381-fc8f-534d-b377-5c6ce1942d59 with scrape type 2
2026-03-24 22:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55067381-fc8f-534d-b377-5c6ce1942d59, identifier: 1978493
2026-03-24 22:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493
2026-03-24 22:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493
2026-03-24 22:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493 to the API
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '55067381-fc8f-534d-b377-5c6ce1942d59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 DIESEL - 2019',
 'odometer': 136511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 DIESEL - 2019 318 dA AdBlue',
 'transmission': 'automatic',
 'trim': '318 dA AdBlue',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978493%27 HTTP/1.1" 200 None
2026-03-24 22:48:25 [ayvens.be] INFO: Saving data for 1978493: {'auction_closing_time': 1774854000.0, 'created_time': 1774305997.51264, 'last_price_update_time': 1774392505.202566}
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978493') HTTP/1.1" 204 0
2026-03-24 22:48:25 [ayvens.be] INFO: Found listing with ID: 1978494
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978494%27 HTTP/1.1" 200 None
2026-03-24 22:48:25 [ayvens.be] INFO: Scrape type for 1978494: 2
2026-03-24 22:48:25 [ayvens.be] INFO: Extracting data for car ID: 1978494
2026-03-24 22:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494
2026-03-24 22:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33fd3e14-efe3-5867-9ca3-466efb909f0f with scrape type 2
2026-03-24 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33fd3e14-efe3-5867-9ca3-466efb909f0f with scrape type 2
2026-03-24 22:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33fd3e14-efe3-5867-9ca3-466efb909f0f, identifier: 1978494
2026-03-24 22:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494
2026-03-24 22:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494
2026-03-24 22:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494 to the API
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '33fd3e14-efe3-5867-9ca3-466efb909f0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON DIESEL',
 'odometer': 132078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON DIESEL 2.0 TDi SCR R-Line (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR R-Line (EU6.2) STOCK',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978494%27 HTTP/1.1" 200 None
2026-03-24 22:48:25 [ayvens.be] INFO: Saving data for 1978494: {'auction_closing_time': 1774854000.0, 'created_time': 1774305967.956642, 'last_price_update_time': 1774392505.572304}
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978494') HTTP/1.1" 204 0
2026-03-24 22:48:25 [ayvens.be] INFO: Found listing with ID: 1978495
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978495%27 HTTP/1.1" 200 None
2026-03-24 22:48:25 [ayvens.be] INFO: Scrape type for 1978495: 2
2026-03-24 22:48:25 [ayvens.be] INFO: Extracting data for car ID: 1978495
2026-03-24 22:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495
2026-03-24 22:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with scrape type 2
2026-03-24 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with scrape type 2
2026-03-24 22:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f, identifier: 1978495
2026-03-24 22:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495
2026-03-24 22:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495
2026-03-24 22:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495 to the API
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 152046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S GT',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S GT',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978495%27 HTTP/1.1" 200 None
2026-03-24 22:48:25 [ayvens.be] INFO: Saving data for 1978495: {'auction_closing_time': 1774854000.0, 'created_time': 1774305996.455177, 'last_price_update_time': 1774392505.923821}
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978495') HTTP/1.1" 204 0
2026-03-24 22:48:25 [ayvens.be] INFO: Found listing with ID: 1978496
2026-03-24 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978496%27 HTTP/1.1" 200 None
2026-03-24 22:48:26 [ayvens.be] INFO: Scrape type for 1978496: 2
2026-03-24 22:48:26 [ayvens.be] INFO: Extracting data for car ID: 1978496
2026-03-24 22:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496
2026-03-24 22:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be2b3d3-d960-5423-8807-a83eafa5bf3b with scrape type 2
2026-03-24 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be2b3d3-d960-5423-8807-a83eafa5bf3b with scrape type 2
2026-03-24 22:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9be2b3d3-d960-5423-8807-a83eafa5bf3b, identifier: 1978496
2026-03-24 22:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496
2026-03-24 22:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496
2026-03-24 22:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496 to the API
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '9be2b3d3-d960-5423-8807-a83eafa5bf3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 161718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.5 35 TFSI S TRONIC',
 'transmission': 'automatic',
 'trim': '1.5 35 TFSI S TRONIC',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978496%27 HTTP/1.1" 200 None
2026-03-24 22:48:26 [ayvens.be] INFO: Saving data for 1978496: {'auction_closing_time': 1774854000.0, 'created_time': 1774305993.517572, 'last_price_update_time': 1774392506.351799}
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978496') HTTP/1.1" 204 0
2026-03-24 22:48:26 [ayvens.be] INFO: Found listing with ID: 1978497
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978497%27 HTTP/1.1" 200 None
2026-03-24 22:48:26 [ayvens.be] INFO: Scrape type for 1978497: 2
2026-03-24 22:48:26 [ayvens.be] INFO: Extracting data for car ID: 1978497
2026-03-24 22:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497
2026-03-24 22:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f29ab27-6670-5485-8d26-306227526cd3 with scrape type 2
2026-03-24 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f29ab27-6670-5485-8d26-306227526cd3 with scrape type 2
2026-03-24 22:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8f29ab27-6670-5485-8d26-306227526cd3, identifier: 1978497
2026-03-24 22:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497
2026-03-24 22:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497
2026-03-24 22:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497 to the API
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '8f29ab27-6670-5485-8d26-306227526cd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 162602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.5 ETSI 96KW DSG LIFE',
 'transmission': 'automatic',
 'trim': '1.5 ETSI 96KW DSG LIFE',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978497%27 HTTP/1.1" 200 None
2026-03-24 22:48:26 [ayvens.be] INFO: Saving data for 1978497: {'auction_closing_time': 1774854000.0, 'created_time': 1774305989.041022, 'last_price_update_time': 1774392506.729354}
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978497') HTTP/1.1" 204 0
2026-03-24 22:48:26 [ayvens.be] INFO: Found listing with ID: 1978498
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978498%27 HTTP/1.1" 200 None
2026-03-24 22:48:26 [ayvens.be] INFO: Scrape type for 1978498: 2
2026-03-24 22:48:26 [ayvens.be] INFO: Extracting data for car ID: 1978498
2026-03-24 22:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498
2026-03-24 22:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with scrape type 2
2026-03-24 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with scrape type 2
2026-03-24 22:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5, identifier: 1978498
2026-03-24 22:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498
2026-03-24 22:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498
2026-03-24 22:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498 to the API
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW DIESEL - 2018',
 'odometer': 164918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW DIESEL - 2018 1.5 BlueHDi Active S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active S&S',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978498%27 HTTP/1.1" 200 None
2026-03-24 22:48:27 [ayvens.be] INFO: Saving data for 1978498: {'auction_closing_time': 1774854000.0, 'created_time': 1774305972.480469, 'last_price_update_time': 1774392507.211616}
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978498') HTTP/1.1" 204 0
2026-03-24 22:48:27 [ayvens.be] INFO: Found listing with ID: 1978499
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978499%27 HTTP/1.1" 200 None
2026-03-24 22:48:27 [ayvens.be] INFO: Scrape type for 1978499: 2
2026-03-24 22:48:27 [ayvens.be] INFO: Extracting data for car ID: 1978499
2026-03-24 22:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499
2026-03-24 22:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5968da5-a67d-559a-b39a-6df374c8874a with scrape type 2
2026-03-24 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5968da5-a67d-559a-b39a-6df374c8874a with scrape type 2
2026-03-24 22:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f5968da5-a67d-559a-b39a-6df374c8874a, identifier: 1978499
2026-03-24 22:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499
2026-03-24 22:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499
2026-03-24 22:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499 to the API
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f5968da5-a67d-559a-b39a-6df374c8874a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS CLIPPER',
 'odometer': 241984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS CLIPPER 1.5 ECOBLUE 85KW ST-LINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 ECOBLUE 85KW ST-LINE AUTO',
 'vin': None,
 'year': 2023}
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978499%27 HTTP/1.1" 200 None
2026-03-24 22:48:27 [ayvens.be] INFO: Saving data for 1978499: {'auction_closing_time': 1774854000.0, 'created_time': 1774305987.735549, 'last_price_update_time': 1774392507.616873}
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978499') HTTP/1.1" 204 0
2026-03-24 22:48:27 [ayvens.be] INFO: Found listing with ID: 1978500
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978500%27 HTTP/1.1" 200 None
2026-03-24 22:48:27 [ayvens.be] INFO: Scrape type for 1978500: 2
2026-03-24 22:48:27 [ayvens.be] INFO: Extracting data for car ID: 1978500
2026-03-24 22:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500
2026-03-24 22:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with scrape type 2
2026-03-24 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with scrape type 2
2026-03-24 22:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e, identifier: 1978500
2026-03-24 22:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500
2026-03-24 22:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500
2026-03-24 22:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500 to the API
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '60b24981-ee9c-5f7d-83b3-a07ef1a2a44e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 148389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 AUTO ACTIVE',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 AUTO ACTIVE',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978500%27 HTTP/1.1" 200 None
2026-03-24 22:48:27 [ayvens.be] INFO: Saving data for 1978500: {'auction_closing_time': 1774854000.0, 'created_time': 1774305986.559407, 'last_price_update_time': 1774392507.992578}
2026-03-24 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978500') HTTP/1.1" 204 0
2026-03-24 22:48:28 [ayvens.be] INFO: Found listing with ID: 1978501
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978501%27 HTTP/1.1" 200 None
2026-03-24 22:48:28 [ayvens.be] INFO: Scrape type for 1978501: 2
2026-03-24 22:48:28 [ayvens.be] INFO: Extracting data for car ID: 1978501
2026-03-24 22:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501
2026-03-24 22:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with scrape type 2
2026-03-24 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with scrape type 2
2026-03-24 22:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b, identifier: 1978501
2026-03-24 22:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501
2026-03-24 22:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501
2026-03-24 22:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501 to the API
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '6e09cf8b-cc7f-50c5-93b3-18a06f65586b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK DIESEL',
 'odometer': 206442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK DIESEL 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978501%27 HTTP/1.1" 200 None
2026-03-24 22:48:28 [ayvens.be] INFO: Saving data for 1978501: {'auction_closing_time': 1774854000.0, 'created_time': 1774305986.20933, 'last_price_update_time': 1774392508.35953}
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978501') HTTP/1.1" 204 0
2026-03-24 22:48:28 [ayvens.be] INFO: Found listing with ID: 1978502
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978502%27 HTTP/1.1" 200 None
2026-03-24 22:48:28 [ayvens.be] INFO: Scrape type for 1978502: 2
2026-03-24 22:48:28 [ayvens.be] INFO: Extracting data for car ID: 1978502
2026-03-24 22:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502
2026-03-24 22:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with scrape type 2
2026-03-24 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with scrape type 2
2026-03-24 22:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e, identifier: 1978502
2026-03-24 22:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502
2026-03-24 22:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502
2026-03-24 22:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502 to the API
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '3.2L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '98fa9be1-2572-5c51-9f7f-a10a53b6d94e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER DOUBLE CAB - 2015',
 'odometer': 249231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER DOUBLE CAB - 2015 3.2 TDCi Wildtrak STOCK',
 'transmission': 'automatic',
 'trim': '3.2 TDCi Wildtrak STOCK',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978502%27 HTTP/1.1" 200 None
2026-03-24 22:48:28 [ayvens.be] INFO: Saving data for 1978502: {'auction_closing_time': 1774854000.0, 'created_time': 1774305984.438999, 'last_price_update_time': 1774392508.735464}
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978502') HTTP/1.1" 204 0
2026-03-24 22:48:28 [ayvens.be] INFO: Found listing with ID: 1978503
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978503%27 HTTP/1.1" 200 None
2026-03-24 22:48:28 [ayvens.be] INFO: Scrape type for 1978503: 2
2026-03-24 22:48:28 [ayvens.be] INFO: Extracting data for car ID: 1978503
2026-03-24 22:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503
2026-03-24 22:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3650d538-54de-5675-abe8-1a8e3d40dcb4 with scrape type 2
2026-03-24 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3650d538-54de-5675-abe8-1a8e3d40dcb4 with scrape type 2
2026-03-24 22:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3650d538-54de-5675-abe8-1a8e3d40dcb4, identifier: 1978503
2026-03-24 22:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503
2026-03-24 22:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503
2026-03-24 22:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503 to the API
2026-03-24 22:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '3650d538-54de-5675-abe8-1a8e3d40dcb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE GRANDTOUR - 2016',
 'odometer': 179004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE GRANDTOUR - 2016 1.33 TCe Corporate Edition GPF '
          '(Fleet)',
 'transmission': 'manual',
 'trim': '1.33 TCe Corporate Edition GPF (Fleet)',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978503%27 HTTP/1.1" 200 None
2026-03-24 22:48:29 [ayvens.be] INFO: Saving data for 1978503: {'auction_closing_time': 1774854000.0, 'created_time': 1774305978.22046, 'last_price_update_time': 1774392509.116852}
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978503') HTTP/1.1" 204 0
2026-03-24 22:48:29 [ayvens.be] INFO: Found listing with ID: 1978504
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978504%27 HTTP/1.1" 200 None
2026-03-24 22:48:29 [ayvens.be] INFO: Scrape type for 1978504: 2
2026-03-24 22:48:29 [ayvens.be] INFO: Extracting data for car ID: 1978504
2026-03-24 22:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504
2026-03-24 22:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with scrape type 2
2026-03-24 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with scrape type 2
2026-03-24 22:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a, identifier: 1978504
2026-03-24 22:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504
2026-03-24 22:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504
2026-03-24 22:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504 to the API
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3d3b41a-5d5a-5c2a-b915-f10d14e3761a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 47706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978504%27 HTTP/1.1" 200 None
2026-03-24 22:48:29 [ayvens.be] INFO: Saving data for 1978504: {'auction_closing_time': 1774854000.0, 'created_time': 1774305983.222158, 'last_price_update_time': 1774392509.502829}
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978504') HTTP/1.1" 204 0
2026-03-24 22:48:29 [ayvens.be] INFO: Found listing with ID: 1978505
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978505%27 HTTP/1.1" 200 None
2026-03-24 22:48:29 [ayvens.be] INFO: Scrape type for 1978505: 2
2026-03-24 22:48:29 [ayvens.be] INFO: Extracting data for car ID: 1978505
2026-03-24 22:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505
2026-03-24 22:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406397f1-cca0-5b08-9891-053ec738b4c6 with scrape type 2
2026-03-24 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406397f1-cca0-5b08-9891-053ec738b4c6 with scrape type 2
2026-03-24 22:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 406397f1-cca0-5b08-9891-053ec738b4c6, identifier: 1978505
2026-03-24 22:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505
2026-03-24 22:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505
2026-03-24 22:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505 to the API
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '406397f1-cca0-5b08-9891-053ec738b4c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV400',
 'odometer': 99981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV400 2.3 DCI 135 L3H2 3.5T ACENTA',
 'transmission': 'manual',
 'trim': '2.3 DCI 135 L3H2 3.5T ACENTA',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978505%27 HTTP/1.1" 200 None
2026-03-24 22:48:29 [ayvens.be] INFO: Saving data for 1978505: {'auction_closing_time': 1774854000.0, 'created_time': 1774305980.737247, 'last_price_update_time': 1774392509.886649}
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978505') HTTP/1.1" 204 0
2026-03-24 22:48:29 [ayvens.be] INFO: Found listing with ID: 1978506
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978506%27 HTTP/1.1" 200 None
2026-03-24 22:48:29 [ayvens.be] INFO: Scrape type for 1978506: 2
2026-03-24 22:48:29 [ayvens.be] INFO: Extracting data for car ID: 1978506
2026-03-24 22:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506
2026-03-24 22:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with scrape type 2
2026-03-24 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with scrape type 2
2026-03-24 22:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb, identifier: 1978506
2026-03-24 22:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506
2026-03-24 22:48:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506
2026-03-24 22:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506 to the API
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'BANQUISE WHITE GLOSS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '67b55a3b-5d0d-522f-b0c3-516eb74e55cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'JUMPY',
 'odometer': 51490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N JUMPY 1.5 BLUEHDI 75KW S-S XL CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S XL CONTROL',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978506%27 HTTP/1.1" 200 None
2026-03-24 22:48:30 [ayvens.be] INFO: Saving data for 1978506: {'auction_closing_time': 1774854000.0, 'created_time': 1774305982.460874, 'last_price_update_time': 1774392510.286257}
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978506') HTTP/1.1" 204 0
2026-03-24 22:48:30 [ayvens.be] INFO: Found listing with ID: 1978507
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978507%27 HTTP/1.1" 200 None
2026-03-24 22:48:30 [ayvens.be] INFO: Scrape type for 1978507: 2
2026-03-24 22:48:30 [ayvens.be] INFO: Extracting data for car ID: 1978507
2026-03-24 22:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507
2026-03-24 22:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264afb82-f54a-51f0-ba3b-45f0345ece79 with scrape type 2
2026-03-24 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 264afb82-f54a-51f0-ba3b-45f0345ece79 with scrape type 2
2026-03-24 22:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 264afb82-f54a-51f0-ba3b-45f0345ece79, identifier: 1978507
2026-03-24 22:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507
2026-03-24 22:48:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507
2026-03-24 22:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507 to the API
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'REFLEX SILVER METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '264afb82-f54a-51f0-ba3b-45f0345ece79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY MAXI VAN DIESEL - 2015',
 'odometer': 160987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY MAXI VAN DIESEL - 2015 2.0 CR TDi SCR (EU6) STOCK',
 'transmission': 'manual',
 'trim': '2.0 CR TDi SCR (EU6) STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978507%27 HTTP/1.1" 200 None
2026-03-24 22:48:30 [ayvens.be] INFO: Saving data for 1978507: {'auction_closing_time': 1774854000.0, 'created_time': 1774305985.112254, 'last_price_update_time': 1774392510.661664}
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978507') HTTP/1.1" 204 0
2026-03-24 22:48:30 [ayvens.be] INFO: Found listing with ID: 1978508
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978508%27 HTTP/1.1" 200 None
2026-03-24 22:48:30 [ayvens.be] INFO: Scrape type for 1978508: 2
2026-03-24 22:48:30 [ayvens.be] INFO: Extracting data for car ID: 1978508
2026-03-24 22:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508
2026-03-24 22:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with scrape type 2
2026-03-24 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with scrape type 2
2026-03-24 22:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2810f775-462c-5d0f-94cf-d0c91b6abcc0, identifier: 1978508
2026-03-24 22:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508
2026-03-24 22:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508
2026-03-24 22:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508 to the API
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '2810f775-462c-5d0f-94cf-d0c91b6abcc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 136038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 2.0CRTDI SCR 81KW BMT SWB 2.8T',
 'transmission': 'manual',
 'trim': '2.0CRTDI SCR 81KW BMT SWB 2.8T',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978508%27 HTTP/1.1" 200 None
2026-03-24 22:48:31 [ayvens.be] INFO: Saving data for 1978508: {'auction_closing_time': 1774854000.0, 'created_time': 1774305988.681362, 'last_price_update_time': 1774392511.0576}
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978508') HTTP/1.1" 204 0
2026-03-24 22:48:31 [ayvens.be] INFO: Found listing with ID: 1978509
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978509%27 HTTP/1.1" 200 None
2026-03-24 22:48:31 [ayvens.be] INFO: Scrape type for 1978509: 2
2026-03-24 22:48:31 [ayvens.be] INFO: Extracting data for car ID: 1978509
2026-03-24 22:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509
2026-03-24 22:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36aec582-042b-575e-a443-7a97cbbb0314 with scrape type 2
2026-03-24 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36aec582-042b-575e-a443-7a97cbbb0314 with scrape type 2
2026-03-24 22:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36aec582-042b-575e-a443-7a97cbbb0314, identifier: 1978509
2026-03-24 22:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509
2026-03-24 22:48:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509
2026-03-24 22:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509 to the API
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '36aec582-042b-575e-a443-7a97cbbb0314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 DIESEL - 2018',
 'odometer': 181024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 DIESEL - 2018 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978509%27 HTTP/1.1" 200 None
2026-03-24 22:48:31 [ayvens.be] INFO: Saving data for 1978509: {'auction_closing_time': 1774854000.0, 'created_time': 1774305991.977314, 'last_price_update_time': 1774392511.74878}
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978509') HTTP/1.1" 204 0
2026-03-24 22:48:31 [ayvens.be] INFO: Found listing with ID: 1978510
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978510%27 HTTP/1.1" 200 None
2026-03-24 22:48:31 [ayvens.be] INFO: Scrape type for 1978510: 2
2026-03-24 22:48:31 [ayvens.be] INFO: Extracting data for car ID: 1978510
2026-03-24 22:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510
2026-03-24 22:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with scrape type 2
2026-03-24 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with scrape type 2
2026-03-24 22:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae, identifier: 1978510
2026-03-24 22:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510
2026-03-24 22:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510
2026-03-24 22:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510 to the API
2026-03-24 22:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '3b7a7ae1-577b-511e-bd30-b9db7a61d7ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 63627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978510%27 HTTP/1.1" 200 None
2026-03-24 22:48:32 [ayvens.be] INFO: Saving data for 1978510: {'auction_closing_time': 1774854000.0, 'created_time': 1774305993.91192, 'last_price_update_time': 1774392512.136047}
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978510') HTTP/1.1" 204 0
2026-03-24 22:48:32 [ayvens.be] INFO: Found listing with ID: 1978511
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978511%27 HTTP/1.1" 200 None
2026-03-24 22:48:32 [ayvens.be] INFO: Scrape type for 1978511: 2
2026-03-24 22:48:32 [ayvens.be] INFO: Extracting data for car ID: 1978511
2026-03-24 22:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511
2026-03-24 22:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841305e5-c403-5982-9930-f2997b99b443 with scrape type 2
2026-03-24 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841305e5-c403-5982-9930-f2997b99b443 with scrape type 2
2026-03-24 22:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 841305e5-c403-5982-9930-f2997b99b443, identifier: 1978511
2026-03-24 22:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511
2026-03-24 22:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511
2026-03-24 22:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511 to the API
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '841305e5-c403-5982-9930-f2997b99b443',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 67436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978511%27 HTTP/1.1" 200 None
2026-03-24 22:48:32 [ayvens.be] INFO: Saving data for 1978511: {'auction_closing_time': 1774854000.0, 'created_time': 1774305995.04962, 'last_price_update_time': 1774392512.52013}
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978511') HTTP/1.1" 204 0
2026-03-24 22:48:32 [ayvens.be] INFO: Found listing with ID: 1978512
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978512%27 HTTP/1.1" 200 None
2026-03-24 22:48:32 [ayvens.be] INFO: Scrape type for 1978512: 2
2026-03-24 22:48:32 [ayvens.be] INFO: Extracting data for car ID: 1978512
2026-03-24 22:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512
2026-03-24 22:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9829e9fa-2169-5fb1-8ddb-3215804f70dd with scrape type 2
2026-03-24 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9829e9fa-2169-5fb1-8ddb-3215804f70dd with scrape type 2
2026-03-24 22:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9829e9fa-2169-5fb1-8ddb-3215804f70dd, identifier: 1978512
2026-03-24 22:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512
2026-03-24 22:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512
2026-03-24 22:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512 to the API
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '9829e9fa-2169-5fb1-8ddb-3215804f70dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 103547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978512%27 HTTP/1.1" 200 None
2026-03-24 22:48:32 [ayvens.be] INFO: Saving data for 1978512: {'auction_closing_time': 1774854000.0, 'created_time': 1774305999.296069, 'last_price_update_time': 1774392512.900796}
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978512') HTTP/1.1" 204 0
2026-03-24 22:48:32 [ayvens.be] INFO: Found listing with ID: 1978513
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978513%27 HTTP/1.1" 200 None
2026-03-24 22:48:32 [ayvens.be] INFO: Scrape type for 1978513: 2
2026-03-24 22:48:32 [ayvens.be] INFO: Extracting data for car ID: 1978513
2026-03-24 22:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513
2026-03-24 22:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4f9804-d955-5197-b2eb-cc47ae31219b with scrape type 2
2026-03-24 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa4f9804-d955-5197-b2eb-cc47ae31219b with scrape type 2
2026-03-24 22:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fa4f9804-d955-5197-b2eb-cc47ae31219b, identifier: 1978513
2026-03-24 22:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513
2026-03-24 22:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513
2026-03-24 22:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513 to the API
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fa4f9804-d955-5197-b2eb-cc47ae31219b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER 335 FOURGON LWB DSL - 20',
 'odometer': 134594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 335 FOURGON LWB DSL - 20 2.0 BlueHDi L3H2 Premium S&S '
          'STOCK',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L3H2 Premium S&S STOCK',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978513%27 HTTP/1.1" 200 None
2026-03-24 22:48:33 [ayvens.be] INFO: Saving data for 1978513: {'auction_closing_time': 1774854000.0, 'created_time': 1774306000.783743, 'last_price_update_time': 1774392513.278526}
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978513') HTTP/1.1" 204 0
2026-03-24 22:48:33 [ayvens.be] INFO: Found listing with ID: 1978514
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978514%27 HTTP/1.1" 200 None
2026-03-24 22:48:33 [ayvens.be] INFO: Scrape type for 1978514: 2
2026-03-24 22:48:33 [ayvens.be] INFO: Extracting data for car ID: 1978514
2026-03-24 22:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514
2026-03-24 22:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with scrape type 2
2026-03-24 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with scrape type 2
2026-03-24 22:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 53ec3909-cd1c-501e-97b6-5b22c83a5f97, identifier: 1978514
2026-03-24 22:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514
2026-03-24 22:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514
2026-03-24 22:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514 to the API
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '53ec3909-cd1c-501e-97b6-5b22c83a5f97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS DSL - 2013',
 'odometer': 127138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS DSL - 2013 1.5 Blue dCi Grand Confort '
          '(EU6d-TEMP)',
 'transmission': 'manual',
 'trim': '1.5 Blue dCi Grand Confort (EU6d-TEMP)',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978514%27 HTTP/1.1" 200 None
2026-03-24 22:48:33 [ayvens.be] INFO: Saving data for 1978514: {'auction_closing_time': 1774854000.0, 'created_time': 1774306007.979295, 'last_price_update_time': 1774392513.633276}
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978514') HTTP/1.1" 204 0
2026-03-24 22:48:33 [ayvens.be] INFO: Found listing with ID: 1978515
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978515%27 HTTP/1.1" 200 None
2026-03-24 22:48:33 [ayvens.be] INFO: Scrape type for 1978515: 2
2026-03-24 22:48:33 [ayvens.be] INFO: Extracting data for car ID: 1978515
2026-03-24 22:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515
2026-03-24 22:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb3a64f-dbc5-5cef-b489-e4111fa7369b with scrape type 2
2026-03-24 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eeb3a64f-dbc5-5cef-b489-e4111fa7369b with scrape type 2
2026-03-24 22:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eeb3a64f-dbc5-5cef-b489-e4111fa7369b, identifier: 1978515
2026-03-24 22:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515
2026-03-24 22:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515
2026-03-24 22:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515 to the API
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eeb3a64f-dbc5-5cef-b489-e4111fa7369b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60 DIESEL - 2018',
 'odometer': 212523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 DIESEL - 2018 2.0 D3 Momentum Pro Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D3 Momentum Pro Geartronic',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978515%27 HTTP/1.1" 200 None
2026-03-24 22:48:34 [ayvens.be] INFO: Saving data for 1978515: {'auction_closing_time': 1774854000.0, 'created_time': 1774306007.623923, 'last_price_update_time': 1774392514.00458}
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978515') HTTP/1.1" 204 0
2026-03-24 22:48:34 [ayvens.be] INFO: Found listing with ID: 1978516
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978516%27 HTTP/1.1" 200 None
2026-03-24 22:48:34 [ayvens.be] INFO: Scrape type for 1978516: 2
2026-03-24 22:48:34 [ayvens.be] INFO: Extracting data for car ID: 1978516
2026-03-24 22:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516
2026-03-24 22:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ad7341-5bb4-5f55-a82c-22c04d424124 with scrape type 2
2026-03-24 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ad7341-5bb4-5f55-a82c-22c04d424124 with scrape type 2
2026-03-24 22:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30ad7341-5bb4-5f55-a82c-22c04d424124, identifier: 1978516
2026-03-24 22:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516
2026-03-24 22:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516
2026-03-24 22:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516 to the API
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '30ad7341-5bb4-5f55-a82c-22c04d424124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 174253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 2.0 TDI 85KW STYLE',
 'transmission': 'manual',
 'trim': '2.0 TDI 85KW STYLE',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978516%27 HTTP/1.1" 200 None
2026-03-24 22:48:34 [ayvens.be] INFO: Saving data for 1978516: {'auction_closing_time': 1774854000.0, 'created_time': 1774306005.759274, 'last_price_update_time': 1774392514.398577}
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978516') HTTP/1.1" 204 0
2026-03-24 22:48:34 [ayvens.be] INFO: Found listing with ID: 1978517
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978517%27 HTTP/1.1" 200 None
2026-03-24 22:48:34 [ayvens.be] INFO: Scrape type for 1978517: 2
2026-03-24 22:48:34 [ayvens.be] INFO: Extracting data for car ID: 1978517
2026-03-24 22:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517
2026-03-24 22:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0280571-db56-5f74-9f1d-4dda9eb6af60 with scrape type 2
2026-03-24 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0280571-db56-5f74-9f1d-4dda9eb6af60 with scrape type 2
2026-03-24 22:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c0280571-db56-5f74-9f1d-4dda9eb6af60, identifier: 1978517
2026-03-24 22:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517
2026-03-24 22:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517
2026-03-24 22:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517 to the API
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0280571-db56-5f74-9f1d-4dda9eb6af60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER 35 LWB DSL - 2014',
 'odometer': 74808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'RENAULT MASTER 35 LWB DSL - 2014 2.3 dCi 35 L3H1 STOCK',
 'transmission': 'manual',
 'trim': '2.3 dCi 35 L3H1 STOCK',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978517%27 HTTP/1.1" 200 None
2026-03-24 22:48:34 [ayvens.be] INFO: Saving data for 1978517: {'auction_closing_time': 1774854000.0, 'created_time': 1774306010.844703, 'last_price_update_time': 1774392514.78465}
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978517') HTTP/1.1" 204 0
2026-03-24 22:48:34 [ayvens.be] INFO: Found listing with ID: 1978518
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978518%27 HTTP/1.1" 200 None
2026-03-24 22:48:34 [ayvens.be] INFO: Scrape type for 1978518: 2
2026-03-24 22:48:34 [ayvens.be] INFO: Extracting data for car ID: 1978518
2026-03-24 22:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518
2026-03-24 22:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e4a439d-7fba-5427-8975-2743b5f404ea with scrape type 2
2026-03-24 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e4a439d-7fba-5427-8975-2743b5f404ea with scrape type 2
2026-03-24 22:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5e4a439d-7fba-5427-8975-2743b5f404ea, identifier: 1978518
2026-03-24 22:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518
2026-03-24 22:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518
2026-03-24 22:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518 to the API
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '5e4a439d-7fba-5427-8975-2743b5f404ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 60841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978518%27 HTTP/1.1" 200 None
2026-03-24 22:48:35 [ayvens.be] INFO: Saving data for 1978518: {'auction_closing_time': 1774854000.0, 'created_time': 1774306039.188929, 'last_price_update_time': 1774392515.160932}
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978518') HTTP/1.1" 204 0
2026-03-24 22:48:35 [ayvens.be] INFO: Found listing with ID: 1978519
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978519%27 HTTP/1.1" 200 None
2026-03-24 22:48:35 [ayvens.be] INFO: Scrape type for 1978519: 2
2026-03-24 22:48:35 [ayvens.be] INFO: Extracting data for car ID: 1978519
2026-03-24 22:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519
2026-03-24 22:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with scrape type 2
2026-03-24 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with scrape type 2
2026-03-24 22:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377, identifier: 1978519
2026-03-24 22:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519
2026-03-24 22:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519
2026-03-24 22:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519 to the API
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '32f2c5d7-05a7-5ac7-9808-a1ed87f59377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 68596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978519%27 HTTP/1.1" 200 None
2026-03-24 22:48:35 [ayvens.be] INFO: Saving data for 1978519: {'auction_closing_time': 1774854000.0, 'created_time': 1774306014.883411, 'last_price_update_time': 1774392515.539021}
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978519') HTTP/1.1" 204 0
2026-03-24 22:48:35 [ayvens.be] INFO: Found listing with ID: 1978520
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978520%27 HTTP/1.1" 200 None
2026-03-24 22:48:35 [ayvens.be] INFO: Scrape type for 1978520: 2
2026-03-24 22:48:35 [ayvens.be] INFO: Extracting data for car ID: 1978520
2026-03-24 22:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520
2026-03-24 22:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 417a8c56-af9b-521e-b580-3853cf048285 with scrape type 2
2026-03-24 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 417a8c56-af9b-521e-b580-3853cf048285 with scrape type 2
2026-03-24 22:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 417a8c56-af9b-521e-b580-3853cf048285, identifier: 1978520
2026-03-24 22:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520
2026-03-24 22:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520
2026-03-24 22:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520 to the API
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '417a8c56-af9b-521e-b580-3853cf048285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 70125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978520%27 HTTP/1.1" 200 None
2026-03-24 22:48:36 [ayvens.be] INFO: Saving data for 1978520: {'auction_closing_time': 1774854000.0, 'created_time': 1774306037.541312, 'last_price_update_time': 1774392516.010079}
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978520') HTTP/1.1" 204 0
2026-03-24 22:48:36 [ayvens.be] INFO: Found listing with ID: 1978521
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978521%27 HTTP/1.1" 200 None
2026-03-24 22:48:36 [ayvens.be] INFO: Scrape type for 1978521: 2
2026-03-24 22:48:36 [ayvens.be] INFO: Extracting data for car ID: 1978521
2026-03-24 22:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521
2026-03-24 22:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with scrape type 2
2026-03-24 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with scrape type 2
2026-03-24 22:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2, identifier: 1978521
2026-03-24 22:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521
2026-03-24 22:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521
2026-03-24 22:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521 to the API
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT DIESEL - 2018',
 'odometer': 177788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT DIESEL - 2018 35 TDi Business Edition Sport S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition Sport S tronic',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978521%27 HTTP/1.1" 200 None
2026-03-24 22:48:36 [ayvens.be] INFO: Saving data for 1978521: {'auction_closing_time': 1774854000.0, 'created_time': 1774306022.959733, 'last_price_update_time': 1774392516.400449}
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978521') HTTP/1.1" 204 0
2026-03-24 22:48:36 [ayvens.be] INFO: Found listing with ID: 1978522
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978522%27 HTTP/1.1" 200 None
2026-03-24 22:48:36 [ayvens.be] INFO: Scrape type for 1978522: 2
2026-03-24 22:48:36 [ayvens.be] INFO: Extracting data for car ID: 1978522
2026-03-24 22:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522
2026-03-24 22:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with scrape type 2
2026-03-24 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with scrape type 2
2026-03-24 22:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2ac3d0d6-67e5-51de-9d44-61670661c6f7, identifier: 1978522
2026-03-24 22:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522
2026-03-24 22:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522
2026-03-24 22:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522 to the API
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '2ac3d0d6-67e5-51de-9d44-61670661c6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON MWB DSL - 2016',
 'odometer': 103529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON MWB DSL - 2016 2.0 BlueHDi L3 Long Premium '
          'S&S STOCK',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L3 Long Premium S&S STOCK',
 'vin': None,
 'year': 2017}
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978522%27 HTTP/1.1" 200 None
2026-03-24 22:48:36 [ayvens.be] INFO: Saving data for 1978522: {'auction_closing_time': 1774854000.0, 'created_time': 1774306020.045803, 'last_price_update_time': 1774392516.776053}
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978522') HTTP/1.1" 204 0
2026-03-24 22:48:36 [ayvens.be] INFO: Found listing with ID: 1978523
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978523%27 HTTP/1.1" 200 None
2026-03-24 22:48:36 [ayvens.be] INFO: Scrape type for 1978523: 2
2026-03-24 22:48:36 [ayvens.be] INFO: Extracting data for car ID: 1978523
2026-03-24 22:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523
2026-03-24 22:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 621c8a2c-56ec-533e-8c87-ae145ea4084a with scrape type 2
2026-03-24 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 621c8a2c-56ec-533e-8c87-ae145ea4084a with scrape type 2
2026-03-24 22:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 621c8a2c-56ec-533e-8c87-ae145ea4084a, identifier: 1978523
2026-03-24 22:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523
2026-03-24 22:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523
2026-03-24 22:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523 to the API
2026-03-24 22:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '621c8a2c-56ec-533e-8c87-ae145ea4084a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 137312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Grand Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Grand Confort',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978523%27 HTTP/1.1" 200 None
2026-03-24 22:48:37 [ayvens.be] INFO: Saving data for 1978523: {'auction_closing_time': 1774854000.0, 'created_time': 1774306019.346682, 'last_price_update_time': 1774392517.152527}
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978523') HTTP/1.1" 204 0
2026-03-24 22:48:37 [ayvens.be] INFO: Found listing with ID: 1978524
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978524%27 HTTP/1.1" 200 None
2026-03-24 22:48:37 [ayvens.be] INFO: Scrape type for 1978524: 2
2026-03-24 22:48:37 [ayvens.be] INFO: Extracting data for car ID: 1978524
2026-03-24 22:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524
2026-03-24 22:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede80ffc-fa67-520c-8216-015908eb4f94 with scrape type 2
2026-03-24 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ede80ffc-fa67-520c-8216-015908eb4f94 with scrape type 2
2026-03-24 22:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ede80ffc-fa67-520c-8216-015908eb4f94, identifier: 1978524
2026-03-24 22:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524
2026-03-24 22:48:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524
2026-03-24 22:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524 to the API
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLANC NACRE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ede80ffc-fa67-520c-8216-015908eb4f94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2017',
 'odometer': 145157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2017 1.5 BlueHDi Allure (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978524%27 HTTP/1.1" 200 None
2026-03-24 22:48:37 [ayvens.be] INFO: Saving data for 1978524: {'auction_closing_time': 1774854000.0, 'created_time': 1774306022.124021, 'last_price_update_time': 1774392517.587631}
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978524') HTTP/1.1" 204 0
2026-03-24 22:48:37 [ayvens.be] INFO: Found listing with ID: 1978525
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978525%27 HTTP/1.1" 200 None
2026-03-24 22:48:37 [ayvens.be] INFO: Scrape type for 1978525: 2
2026-03-24 22:48:37 [ayvens.be] INFO: Extracting data for car ID: 1978525
2026-03-24 22:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525
2026-03-24 22:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c162cd1b-f0a8-5d66-aa9d-858044663a69 with scrape type 2
2026-03-24 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c162cd1b-f0a8-5d66-aa9d-858044663a69 with scrape type 2
2026-03-24 22:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c162cd1b-f0a8-5d66-aa9d-858044663a69, identifier: 1978525
2026-03-24 22:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525
2026-03-24 22:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525
2026-03-24 22:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525 to the API
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c162cd1b-f0a8-5d66-aa9d-858044663a69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 100509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-14',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978525%27 HTTP/1.1" 200 None
2026-03-24 22:48:37 [ayvens.be] INFO: Saving data for 1978525: {'auction_closing_time': 1774854000.0, 'created_time': 1774306024.823426, 'last_price_update_time': 1774392517.968447}
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978525') HTTP/1.1" 204 0
2026-03-24 22:48:37 [ayvens.be] INFO: Found listing with ID: 1978526
2026-03-24 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978526%27 HTTP/1.1" 200 None
2026-03-24 22:48:38 [ayvens.be] INFO: Scrape type for 1978526: 2
2026-03-24 22:48:38 [ayvens.be] INFO: Extracting data for car ID: 1978526
2026-03-24 22:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526
2026-03-24 22:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with scrape type 2
2026-03-24 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with scrape type 2
2026-03-24 22:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7, identifier: 1978526
2026-03-24 22:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526
2026-03-24 22:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526
2026-03-24 22:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526 to the API
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350L FOU LWB HR DSL',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350L FOU LWB HR DSL 2.0 TDCi L3H2 Trend',
 'transmission': 'automatic',
 'trim': '2.0 TDCi L3H2 Trend',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978526%27 HTTP/1.1" 200 None
2026-03-24 22:48:38 [ayvens.be] INFO: Saving data for 1978526: {'auction_closing_time': 1774854000.0, 'created_time': 1774306032.150657, 'last_price_update_time': 1774392518.350911}
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978526') HTTP/1.1" 204 0
2026-03-24 22:48:38 [ayvens.be] INFO: Found listing with ID: 1978527
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978527%27 HTTP/1.1" 200 None
2026-03-24 22:48:38 [ayvens.be] INFO: Scrape type for 1978527: 2
2026-03-24 22:48:38 [ayvens.be] INFO: Extracting data for car ID: 1978527
2026-03-24 22:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527
2026-03-24 22:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with scrape type 2
2026-03-24 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with scrape type 2
2026-03-24 22:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8, identifier: 1978527
2026-03-24 22:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527
2026-03-24 22:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527
2026-03-24 22:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527 to the API
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '74ae79bb-c687-5941-80f0-bb5bc5a8f0e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 133993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978527%27 HTTP/1.1" 200 None
2026-03-24 22:48:38 [ayvens.be] INFO: Saving data for 1978527: {'auction_closing_time': 1774854000.0, 'created_time': 1774306027.420883, 'last_price_update_time': 1774392518.744403}
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978527') HTTP/1.1" 204 0
2026-03-24 22:48:38 [ayvens.be] INFO: Found listing with ID: 1978528
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978528%27 HTTP/1.1" 200 None
2026-03-24 22:48:38 [ayvens.be] INFO: Scrape type for 1978528: 2
2026-03-24 22:48:38 [ayvens.be] INFO: Extracting data for car ID: 1978528
2026-03-24 22:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528
2026-03-24 22:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85a756ef-87cd-5fbf-967b-f33557744fc5 with scrape type 2
2026-03-24 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85a756ef-87cd-5fbf-967b-f33557744fc5 with scrape type 2
2026-03-24 22:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85a756ef-87cd-5fbf-967b-f33557744fc5, identifier: 1978528
2026-03-24 22:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528
2026-03-24 22:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528
2026-03-24 22:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528 to the API
2026-03-24 22:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '85a756ef-87cd-5fbf-967b-f33557744fc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 54570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978528%27 HTTP/1.1" 200 None
2026-03-24 22:48:39 [ayvens.be] INFO: Saving data for 1978528: {'auction_closing_time': 1774854000.0, 'created_time': 1774306029.160378, 'last_price_update_time': 1774392519.167855}
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978528') HTTP/1.1" 204 0
2026-03-24 22:48:39 [ayvens.be] INFO: Found listing with ID: 1978529
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978529%27 HTTP/1.1" 200 None
2026-03-24 22:48:39 [ayvens.be] INFO: Scrape type for 1978529: 2
2026-03-24 22:48:39 [ayvens.be] INFO: Extracting data for car ID: 1978529
2026-03-24 22:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529
2026-03-24 22:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce6f2a4e-0964-55ca-a00b-00998c38e97b with scrape type 2
2026-03-24 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce6f2a4e-0964-55ca-a00b-00998c38e97b with scrape type 2
2026-03-24 22:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ce6f2a4e-0964-55ca-a00b-00998c38e97b, identifier: 1978529
2026-03-24 22:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529
2026-03-24 22:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529
2026-03-24 22:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529 to the API
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce6f2a4e-0964-55ca-a00b-00998c38e97b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 212761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978529%27 HTTP/1.1" 200 None
2026-03-24 22:48:39 [ayvens.be] INFO: Saving data for 1978529: {'auction_closing_time': 1774854000.0, 'created_time': 1774306031.397081, 'last_price_update_time': 1774392519.547207}
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978529') HTTP/1.1" 204 0
2026-03-24 22:48:39 [ayvens.be] INFO: Found listing with ID: 1978530
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978530%27 HTTP/1.1" 200 None
2026-03-24 22:48:39 [ayvens.be] INFO: Scrape type for 1978530: 2
2026-03-24 22:48:39 [ayvens.be] INFO: Extracting data for car ID: 1978530
2026-03-24 22:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530
2026-03-24 22:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63a7700a-9aab-5b25-81db-fb8e247c112d with scrape type 2
2026-03-24 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63a7700a-9aab-5b25-81db-fb8e247c112d with scrape type 2
2026-03-24 22:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63a7700a-9aab-5b25-81db-fb8e247c112d, identifier: 1978530
2026-03-24 22:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530
2026-03-24 22:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530
2026-03-24 22:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530 to the API
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '63a7700a-9aab-5b25-81db-fb8e247c112d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'MULTIVAN',
 'odometer': 124374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN MULTIVAN 1.4 EHYBRID PHEV DSG ENERGETIC',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID PHEV DSG ENERGETIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978530%27 HTTP/1.1" 200 None
2026-03-24 22:48:39 [ayvens.be] INFO: Saving data for 1978530: {'auction_closing_time': 1774854000.0, 'created_time': 1774306033.824887, 'last_price_update_time': 1774392519.921933}
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978530') HTTP/1.1" 204 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978531
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978531%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978531: 2
2026-03-24 22:48:40 [ayvens.be] INFO: Extracting data for car ID: 1978531
2026-03-24 22:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531
2026-03-24 22:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c85626-29d2-535a-8e62-d33afc1b51be with scrape type 2
2026-03-24 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73c85626-29d2-535a-8e62-d33afc1b51be with scrape type 2
2026-03-24 22:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 73c85626-29d2-535a-8e62-d33afc1b51be, identifier: 1978531
2026-03-24 22:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531
2026-03-24 22:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531
2026-03-24 22:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531 to the API
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '73c85626-29d2-535a-8e62-d33afc1b51be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU LWB DSL -',
 'odometer': 212303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU LWB DSL - 2.0 TDi SCR 4Motion BMT '
          'DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi SCR 4Motion BMT DSG',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978531%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Saving data for 1978531: {'auction_closing_time': 1774854000.0, 'created_time': 1774306035.537882, 'last_price_update_time': 1774392520.365294}
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978531') HTTP/1.1" 204 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978532
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978532%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978532: 2
2026-03-24 22:48:40 [ayvens.be] INFO: Extracting data for car ID: 1978532
2026-03-24 22:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532
2026-03-24 22:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with scrape type 2
2026-03-24 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with scrape type 2
2026-03-24 22:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f, identifier: 1978532
2026-03-24 22:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532
2026-03-24 22:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532
2026-03-24 22:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532 to the API
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 36721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978532%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Saving data for 1978532: {'auction_closing_time': 1774854000.0, 'created_time': 1774306036.684049, 'last_price_update_time': 1774392520.719854}
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978532') HTTP/1.1" 204 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978542
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978542%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978542: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978543
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978543%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978543: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978544
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978544%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978544: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978545
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978545%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978545: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978546
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978546%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978546: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978547
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978547%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978547: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978548
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978548%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978548: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978549
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978549%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978549: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978550
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978550%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978550: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978551
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978551%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978551: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978552
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978552%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978552: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978553
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978553%27 HTTP/1.1" 200 None
2026-03-24 22:48:40 [ayvens.be] INFO: Scrape type for 1978553: 0
2026-03-24 22:48:40 [ayvens.be] INFO: Found listing with ID: 1978554
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978554%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978554: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978555
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978555%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978555: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978556
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978556%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978556: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978557
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978557%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978557: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978558
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978558%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978558: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978559
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978559%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978559: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978560
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978560%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978560: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978561
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978561%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978561: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978562
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978562%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978562: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978563
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978563%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978563: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978564
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978564%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978564: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978565
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978565%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978565: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978566
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978566%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978566: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978567
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978567%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978567: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978568
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978568%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978568: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978569
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978569%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978569: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978570
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978570%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978570: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978571
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978571%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978571: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1978572
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978572%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1978572: 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1977588
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977588%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1977588: 2
2026-03-24 22:48:41 [ayvens.be] INFO: Extracting data for car ID: 1977588
2026-03-24 22:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588
2026-03-24 22:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb2b1fe-1187-5175-98ae-c32eb513fadd with scrape type 2
2026-03-24 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb2b1fe-1187-5175-98ae-c32eb513fadd with scrape type 2
2026-03-24 22:48:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: abb2b1fe-1187-5175-98ae-c32eb513fadd, identifier: 1977588
2026-03-24 22:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588
2026-03-24 22:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588
2026-03-24 22:48:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588 to the API
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'abb2b1fe-1187-5175-98ae-c32eb513fadd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 48824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI 81KW ACTIVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977588%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Saving data for 1977588: {'auction_closing_time': 1774600200.0, 'created_time': 1774306041.233719, 'last_price_update_time': 1774392521.705111}
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977588') HTTP/1.1" 204 0
2026-03-24 22:48:41 [ayvens.be] INFO: Found listing with ID: 1977589
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977589%27 HTTP/1.1" 200 None
2026-03-24 22:48:41 [ayvens.be] INFO: Scrape type for 1977589: 2
2026-03-24 22:48:41 [ayvens.be] INFO: Extracting data for car ID: 1977589
2026-03-24 22:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589
2026-03-24 22:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with scrape type 2
2026-03-24 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with scrape type 2
2026-03-24 22:48:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca, identifier: 1977589
2026-03-24 22:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589
2026-03-24 22:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589
2026-03-24 22:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589 to the API
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5bd88324-1259-50cd-b0e6-dc66d9bc91ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 138981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977589%27 HTTP/1.1" 200 None
2026-03-24 22:48:42 [ayvens.be] INFO: Saving data for 1977589: {'auction_closing_time': 1774600200.0, 'created_time': 1774306043.050818, 'last_price_update_time': 1774392522.186756}
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977589') HTTP/1.1" 204 0
2026-03-24 22:48:42 [ayvens.be] INFO: Found listing with ID: 1977590
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977590%27 HTTP/1.1" 200 None
2026-03-24 22:48:42 [ayvens.be] INFO: Scrape type for 1977590: 2
2026-03-24 22:48:42 [ayvens.be] INFO: Extracting data for car ID: 1977590
2026-03-24 22:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590
2026-03-24 22:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with scrape type 2
2026-03-24 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with scrape type 2
2026-03-24 22:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 932666f8-0f6a-5088-b3d6-cbe5b8a89457, identifier: 1977590
2026-03-24 22:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590
2026-03-24 22:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590
2026-03-24 22:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590 to the API
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '932666f8-0f6a-5088-b3d6-cbe5b8a89457',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 51223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO 1.3 TCE 130 TECHNO',
 'transmission': 'manual',
 'trim': '1.3 TCE 130 TECHNO',
 'vin': None,
 'year': 2023}
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977590%27 HTTP/1.1" 200 None
2026-03-24 22:48:42 [ayvens.be] INFO: Saving data for 1977590: {'auction_closing_time': 1774600200.0, 'created_time': 1774306042.219191, 'last_price_update_time': 1774392522.544077}
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977590') HTTP/1.1" 204 0
2026-03-24 22:48:42 [ayvens.be] INFO: Found listing with ID: 1977591
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977591%27 HTTP/1.1" 200 None
2026-03-24 22:48:42 [ayvens.be] INFO: Scrape type for 1977591: 2
2026-03-24 22:48:42 [ayvens.be] INFO: Extracting data for car ID: 1977591
2026-03-24 22:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591
2026-03-24 22:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d4de2a-4015-517f-96a4-5e1712ae4e3c with scrape type 2
2026-03-24 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d4de2a-4015-517f-96a4-5e1712ae4e3c with scrape type 2
2026-03-24 22:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 34d4de2a-4015-517f-96a4-5e1712ae4e3c, identifier: 1977591
2026-03-24 22:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591
2026-03-24 22:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591
2026-03-24 22:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591 to the API
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '34d4de2a-4015-517f-96a4-5e1712ae4e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 DIESEL - 2018',
 'odometer': 171581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 DIESEL - 2018 1.5 BlueHDi Allure S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Allure S&S',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977591%27 HTTP/1.1" 200 None
2026-03-24 22:48:42 [ayvens.be] INFO: Saving data for 1977591: {'auction_closing_time': 1774600200.0, 'created_time': 1774306044.059916, 'last_price_update_time': 1774392522.947531}
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977591') HTTP/1.1" 204 0
2026-03-24 22:48:42 [ayvens.be] INFO: Found listing with ID: 1977592
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977592%27 HTTP/1.1" 200 None
2026-03-24 22:48:42 [ayvens.be] INFO: Scrape type for 1977592: 2
2026-03-24 22:48:42 [ayvens.be] INFO: Extracting data for car ID: 1977592
2026-03-24 22:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592
2026-03-24 22:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d850c4ed-2023-5c25-a4d6-4cd243c4fccc with scrape type 2
2026-03-24 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d850c4ed-2023-5c25-a4d6-4cd243c4fccc with scrape type 2
2026-03-24 22:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d850c4ed-2023-5c25-a4d6-4cd243c4fccc, identifier: 1977592
2026-03-24 22:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592
2026-03-24 22:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592
2026-03-24 22:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592 to the API
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd850c4ed-2023-5c25-a4d6-4cd243c4fccc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 64414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TSI 130 MOVE!',
 'transmission': 'manual',
 'trim': '1.5 TSI 130 MOVE!',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977592%27 HTTP/1.1" 200 None
2026-03-24 22:48:43 [ayvens.be] INFO: Saving data for 1977592: {'auction_closing_time': 1774600200.0, 'created_time': 1774306045.966308, 'last_price_update_time': 1774392523.310782}
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977592') HTTP/1.1" 204 0
2026-03-24 22:48:43 [ayvens.be] INFO: Found listing with ID: 1977593
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977593%27 HTTP/1.1" 200 None
2026-03-24 22:48:43 [ayvens.be] INFO: Scrape type for 1977593: 2
2026-03-24 22:48:43 [ayvens.be] INFO: Extracting data for car ID: 1977593
2026-03-24 22:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593
2026-03-24 22:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e90ffccc-9938-5977-bc0e-6e08036ae069 with scrape type 2
2026-03-24 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e90ffccc-9938-5977-bc0e-6e08036ae069 with scrape type 2
2026-03-24 22:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e90ffccc-9938-5977-bc0e-6e08036ae069, identifier: 1977593
2026-03-24 22:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593
2026-03-24 22:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593
2026-03-24 22:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593 to the API
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e90ffccc-9938-5977-bc0e-6e08036ae069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VII - 2017',
 'odometer': 77662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VII - 2017 1.0 TSI IQ.Drive OPF (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.0 TSI IQ.Drive OPF (EU6.2) STOCK',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977593%27 HTTP/1.1" 200 None
2026-03-24 22:48:43 [ayvens.be] INFO: Saving data for 1977593: {'auction_closing_time': 1774600200.0, 'created_time': 1774306047.666412, 'last_price_update_time': 1774392523.683924}
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977593') HTTP/1.1" 204 0
2026-03-24 22:48:43 [ayvens.be] INFO: Found listing with ID: 1977594
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977594%27 HTTP/1.1" 200 None
2026-03-24 22:48:43 [ayvens.be] INFO: Scrape type for 1977594: 2
2026-03-24 22:48:43 [ayvens.be] INFO: Extracting data for car ID: 1977594
2026-03-24 22:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594
2026-03-24 22:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with scrape type 2
2026-03-24 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with scrape type 2
2026-03-24 22:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a96b1911-50f3-590a-a4ec-e5a03ecf00e9, identifier: 1977594
2026-03-24 22:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594
2026-03-24 22:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594
2026-03-24 22:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594 to the API
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a96b1911-50f3-590a-a4ec-e5a03ecf00e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 74135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.5 TSI ACT 110KW DSG7 STYLE',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT 110KW DSG7 STYLE',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977594%27 HTTP/1.1" 200 None
2026-03-24 22:48:44 [ayvens.be] INFO: Saving data for 1977594: {'auction_closing_time': 1774600200.0, 'created_time': 1774306048.761324, 'last_price_update_time': 1774392524.07369}
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977594') HTTP/1.1" 204 0
2026-03-24 22:48:44 [ayvens.be] INFO: Found listing with ID: 1977595
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977595%27 HTTP/1.1" 200 None
2026-03-24 22:48:44 [ayvens.be] INFO: Scrape type for 1977595: 2
2026-03-24 22:48:44 [ayvens.be] INFO: Extracting data for car ID: 1977595
2026-03-24 22:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595
2026-03-24 22:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f10890-fbfa-5c4d-bf38-f27198dee1ba with scrape type 2
2026-03-24 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f10890-fbfa-5c4d-bf38-f27198dee1ba with scrape type 2
2026-03-24 22:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0f10890-fbfa-5c4d-bf38-f27198dee1ba, identifier: 1977595
2026-03-24 22:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595
2026-03-24 22:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595
2026-03-24 22:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595 to the API
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd0f10890-fbfa-5c4d-bf38-f27198dee1ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 89450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2023}
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977595%27 HTTP/1.1" 200 None
2026-03-24 22:48:44 [ayvens.be] INFO: Saving data for 1977595: {'auction_closing_time': 1774600200.0, 'created_time': 1774306051.293206, 'last_price_update_time': 1774392524.456458}
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977595') HTTP/1.1" 204 0
2026-03-24 22:48:44 [ayvens.be] INFO: Found listing with ID: 1977596
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977596%27 HTTP/1.1" 200 None
2026-03-24 22:48:44 [ayvens.be] INFO: Scrape type for 1977596: 2
2026-03-24 22:48:44 [ayvens.be] INFO: Extracting data for car ID: 1977596
2026-03-24 22:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596
2026-03-24 22:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37963a9-72b0-56df-9d20-931da101e100 with scrape type 2
2026-03-24 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e37963a9-72b0-56df-9d20-931da101e100 with scrape type 2
2026-03-24 22:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e37963a9-72b0-56df-9d20-931da101e100, identifier: 1977596
2026-03-24 22:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596
2026-03-24 22:48:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596
2026-03-24 22:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596 to the API
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'GRIS MOUSSON',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e37963a9-72b0-56df-9d20-931da101e100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK DIESEL - 2017',
 'odometer': 99196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK DIESEL - 2017 35 TDi Business Ed. Sport S '
          'tr.(EU6d-T.) STOCK',
 'transmission': 'automatic',
 'trim': '35 TDi Business Ed. Sport S tr.(EU6d-T.) STOCK',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977596%27 HTTP/1.1" 200 None
2026-03-24 22:48:44 [ayvens.be] INFO: Saving data for 1977596: {'auction_closing_time': 1774600200.0, 'created_time': 1774306052.808567, 'last_price_update_time': 1774392524.858187}
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977596') HTTP/1.1" 204 0
2026-03-24 22:48:44 [ayvens.be] INFO: Found listing with ID: 1977597
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977597%27 HTTP/1.1" 200 None
2026-03-24 22:48:44 [ayvens.be] INFO: Scrape type for 1977597: 2
2026-03-24 22:48:44 [ayvens.be] INFO: Extracting data for car ID: 1977597
2026-03-24 22:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597
2026-03-24 22:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bce7930-7026-5318-9fe3-ebf52b3266a2 with scrape type 2
2026-03-24 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bce7930-7026-5318-9fe3-ebf52b3266a2 with scrape type 2
2026-03-24 22:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4bce7930-7026-5318-9fe3-ebf52b3266a2, identifier: 1977597
2026-03-24 22:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597
2026-03-24 22:48:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597
2026-03-24 22:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597 to the API
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'MYTHOSZWART METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '4bce7930-7026-5318-9fe3-ebf52b3266a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON SPORTBACK',
 'odometer': 62593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON SPORTBACK BEV 95KWH 55 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 95KWH 55 QUATTRO S-LINE',
 'vin': None,
 'year': 2023}
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977597%27 HTTP/1.1" 200 None
2026-03-24 22:48:45 [ayvens.be] INFO: Saving data for 1977597: {'auction_closing_time': 1774600200.0, 'created_time': 1774306053.788242, 'last_price_update_time': 1774392525.259048}
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977597') HTTP/1.1" 204 0
2026-03-24 22:48:45 [ayvens.be] INFO: Found listing with ID: 1977598
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977598%27 HTTP/1.1" 200 None
2026-03-24 22:48:45 [ayvens.be] INFO: Scrape type for 1977598: 2
2026-03-24 22:48:45 [ayvens.be] INFO: Extracting data for car ID: 1977598
2026-03-24 22:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598
2026-03-24 22:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7f49b01-1325-5392-9f15-deff8c69e130 with scrape type 2
2026-03-24 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7f49b01-1325-5392-9f15-deff8c69e130 with scrape type 2
2026-03-24 22:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f7f49b01-1325-5392-9f15-deff8c69e130, identifier: 1977598
2026-03-24 22:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598
2026-03-24 22:48:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598
2026-03-24 22:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598 to the API
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'ARTENSE GRIJS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f7f49b01-1325-5392-9f15-deff8c69e130',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 53762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 96KW S-S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977598%27 HTTP/1.1" 200 None
2026-03-24 22:48:45 [ayvens.be] INFO: Saving data for 1977598: {'auction_closing_time': 1774600200.0, 'created_time': 1774306055.985428, 'last_price_update_time': 1774392525.652886}
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977598') HTTP/1.1" 204 0
2026-03-24 22:48:45 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-24 22:48:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:48:47 [ayvens.be] INFO: Found listing with ID: 1977599
2026-03-24 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977599%27 HTTP/1.1" 200 None
2026-03-24 22:48:47 [ayvens.be] INFO: Scrape type for 1977599: 2
2026-03-24 22:48:47 [ayvens.be] INFO: Extracting data for car ID: 1977599
2026-03-24 22:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599
2026-03-24 22:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d482a2f-1d47-5029-ac61-56fc91746d15 with scrape type 2
2026-03-24 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d482a2f-1d47-5029-ac61-56fc91746d15 with scrape type 2
2026-03-24 22:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6d482a2f-1d47-5029-ac61-56fc91746d15, identifier: 1977599
2026-03-24 22:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599
2026-03-24 22:48:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599
2026-03-24 22:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599 to the API
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'color': 'WIT',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '6d482a2f-1d47-5029-ac61-56fc91746d15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 57018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter 314 2.1 BlueTEC A1 (EU6)',
 'transmission': 'manual',
 'trim': '314 2.1 BlueTEC A1 (EU6)',
 'vin': None,
 'year': 2018}
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977599%27 HTTP/1.1" 200 None
2026-03-24 22:48:48 [ayvens.be] INFO: Saving data for 1977599: {'auction_closing_time': 1774600200.0, 'created_time': 1774306057.470995, 'last_price_update_time': 1774392528.29088}
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977599') HTTP/1.1" 204 0
2026-03-24 22:48:48 [ayvens.be] INFO: Found listing with ID: 1977600
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977600%27 HTTP/1.1" 200 None
2026-03-24 22:48:48 [ayvens.be] INFO: Scrape type for 1977600: 2
2026-03-24 22:48:48 [ayvens.be] INFO: Extracting data for car ID: 1977600
2026-03-24 22:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600
2026-03-24 22:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2af76393-e37f-5faf-b1cf-9c20ca7639fc with scrape type 2
2026-03-24 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2af76393-e37f-5faf-b1cf-9c20ca7639fc with scrape type 2
2026-03-24 22:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2af76393-e37f-5faf-b1cf-9c20ca7639fc, identifier: 1977600
2026-03-24 22:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600
2026-03-24 22:48:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600
2026-03-24 22:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600 to the API
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2af76393-e37f-5faf-b1cf-9c20ca7639fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-Klasse Cabrio',
 'odometer': 144788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-Klasse Cabrio C 200 4-Matic Mild Hybrid',
 'transmission': 'automatic',
 'trim': 'C 200 4-Matic Mild Hybrid',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977600%27 HTTP/1.1" 200 None
2026-03-24 22:48:48 [ayvens.be] INFO: Saving data for 1977600: {'auction_closing_time': 1774600200.0, 'created_time': 1774306058.958671, 'last_price_update_time': 1774392528.757142}
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977600') HTTP/1.1" 204 0
2026-03-24 22:48:48 [ayvens.be] INFO: Found listing with ID: 1977601
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977601%27 HTTP/1.1" 200 None
2026-03-24 22:48:48 [ayvens.be] INFO: Scrape type for 1977601: 2
2026-03-24 22:48:48 [ayvens.be] INFO: Extracting data for car ID: 1977601
2026-03-24 22:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601
2026-03-24 22:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56df818-8bf0-5f81-a7da-fe9cad171e2e with scrape type 2
2026-03-24 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f56df818-8bf0-5f81-a7da-fe9cad171e2e with scrape type 2
2026-03-24 22:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f56df818-8bf0-5f81-a7da-fe9cad171e2e, identifier: 1977601
2026-03-24 22:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601
2026-03-24 22:48:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601
2026-03-24 22:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601 to the API
2026-03-24 22:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'DEEP BLACK METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f56df818-8bf0-5f81-a7da-fe9cad171e2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 62743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI Life OPF',
 'transmission': 'manual',
 'trim': '1.0 TSI Life OPF',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977601%27 HTTP/1.1" 200 None
2026-03-24 22:48:49 [ayvens.be] INFO: Saving data for 1977601: {'auction_closing_time': 1774600200.0, 'created_time': 1774306060.155854, 'last_price_update_time': 1774392529.158053}
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977601') HTTP/1.1" 204 0
2026-03-24 22:48:49 [ayvens.be] INFO: Found listing with ID: 1977602
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977602%27 HTTP/1.1" 200 None
2026-03-24 22:48:49 [ayvens.be] INFO: Scrape type for 1977602: 2
2026-03-24 22:48:49 [ayvens.be] INFO: Extracting data for car ID: 1977602
2026-03-24 22:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602
2026-03-24 22:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2941fa4c-aec4-50a6-98af-7473d002cb85 with scrape type 2
2026-03-24 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2941fa4c-aec4-50a6-98af-7473d002cb85 with scrape type 2
2026-03-24 22:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2941fa4c-aec4-50a6-98af-7473d002cb85, identifier: 1977602
2026-03-24 22:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602
2026-03-24 22:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602
2026-03-24 22:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602 to the API
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2941fa4c-aec4-50a6-98af-7473d002cb85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 44418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT 1.5 TSI ELEGANCE BUSINESS',
 'transmission': 'manual',
 'trim': '1.5 TSI ELEGANCE BUSINESS',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977602%27 HTTP/1.1" 200 None
2026-03-24 22:48:49 [ayvens.be] INFO: Saving data for 1977602: {'auction_closing_time': 1774600200.0, 'created_time': 1774306061.734184, 'last_price_update_time': 1774392529.556096}
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977602') HTTP/1.1" 204 0
2026-03-24 22:48:49 [ayvens.be] INFO: Found listing with ID: 1977603
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977603%27 HTTP/1.1" 200 None
2026-03-24 22:48:49 [ayvens.be] INFO: Scrape type for 1977603: 2
2026-03-24 22:48:49 [ayvens.be] INFO: Extracting data for car ID: 1977603
2026-03-24 22:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603
2026-03-24 22:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a835356a-e1ff-5562-82aa-d8865b27de10 with scrape type 2
2026-03-24 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a835356a-e1ff-5562-82aa-d8865b27de10 with scrape type 2
2026-03-24 22:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a835356a-e1ff-5562-82aa-d8865b27de10, identifier: 1977603
2026-03-24 22:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603
2026-03-24 22:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603
2026-03-24 22:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603 to the API
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a835356a-e1ff-5562-82aa-d8865b27de10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 DIESEL - 2017',
 'odometer': 118295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 DIESEL - 2017 40 TDi Quattro Business Ed.Sport S tr.',
 'transmission': 'automatic',
 'trim': '40 TDi Quattro Business Ed.Sport S tr.',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977603%27 HTTP/1.1" 200 None
2026-03-24 22:48:49 [ayvens.be] INFO: Saving data for 1977603: {'auction_closing_time': 1774600200.0, 'created_time': 1774306063.588895, 'last_price_update_time': 1774392529.925222}
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977603') HTTP/1.1" 204 0
2026-03-24 22:48:49 [ayvens.be] INFO: Found listing with ID: 1977604
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977604%27 HTTP/1.1" 200 None
2026-03-24 22:48:49 [ayvens.be] INFO: Scrape type for 1977604: 2
2026-03-24 22:48:49 [ayvens.be] INFO: Extracting data for car ID: 1977604
2026-03-24 22:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604
2026-03-24 22:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a6f24ed-99e1-5ec3-9106-1655f246e37e with scrape type 2
2026-03-24 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a6f24ed-99e1-5ec3-9106-1655f246e37e with scrape type 2
2026-03-24 22:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a6f24ed-99e1-5ec3-9106-1655f246e37e, identifier: 1977604
2026-03-24 22:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604
2026-03-24 22:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604
2026-03-24 22:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604 to the API
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7a6f24ed-99e1-5ec3-9106-1655f246e37e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 138907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 2.0iA sDrive20 OPF',
 'transmission': 'automatic',
 'trim': '2.0iA sDrive20 OPF',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977604%27 HTTP/1.1" 200 None
2026-03-24 22:48:50 [ayvens.be] INFO: Saving data for 1977604: {'auction_closing_time': 1774600200.0, 'created_time': 1774306066.166069, 'last_price_update_time': 1774392530.28779}
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977604') HTTP/1.1" 204 0
2026-03-24 22:48:50 [ayvens.be] INFO: Found listing with ID: 1977605
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977605%27 HTTP/1.1" 200 None
2026-03-24 22:48:50 [ayvens.be] INFO: Scrape type for 1977605: 2
2026-03-24 22:48:50 [ayvens.be] INFO: Extracting data for car ID: 1977605
2026-03-24 22:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605
2026-03-24 22:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c18e68-edc9-57f6-9299-53c5e886f251 with scrape type 2
2026-03-24 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c18e68-edc9-57f6-9299-53c5e886f251 with scrape type 2
2026-03-24 22:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 75c18e68-edc9-57f6-9299-53c5e886f251, identifier: 1977605
2026-03-24 22:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605
2026-03-24 22:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605
2026-03-24 22:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605 to the API
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '75c18e68-edc9-57f6-9299-53c5e886f251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 109624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977605%27 HTTP/1.1" 200 None
2026-03-24 22:48:50 [ayvens.be] INFO: Saving data for 1977605: {'auction_closing_time': 1774600200.0, 'created_time': 1774306067.417949, 'last_price_update_time': 1774392530.664656}
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977605') HTTP/1.1" 204 0
2026-03-24 22:48:50 [ayvens.be] INFO: Found listing with ID: 1977606
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977606%27 HTTP/1.1" 200 None
2026-03-24 22:48:50 [ayvens.be] INFO: Scrape type for 1977606: 2
2026-03-24 22:48:50 [ayvens.be] INFO: Extracting data for car ID: 1977606
2026-03-24 22:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606
2026-03-24 22:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eb65c18-35ff-5232-bfe6-c831d5449f2f with scrape type 2
2026-03-24 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eb65c18-35ff-5232-bfe6-c831d5449f2f with scrape type 2
2026-03-24 22:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8eb65c18-35ff-5232-bfe6-c831d5449f2f, identifier: 1977606
2026-03-24 22:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606
2026-03-24 22:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606
2026-03-24 22:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606 to the API
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8eb65c18-35ff-5232-bfe6-c831d5449f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 102353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 B 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977606%27 HTTP/1.1" 200 None
2026-03-24 22:48:51 [ayvens.be] INFO: Saving data for 1977606: {'auction_closing_time': 1774600200.0, 'created_time': 1774306068.461204, 'last_price_update_time': 1774392531.036033}
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977606') HTTP/1.1" 204 0
2026-03-24 22:48:51 [ayvens.be] INFO: Found listing with ID: 1977607
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977607%27 HTTP/1.1" 200 None
2026-03-24 22:48:51 [ayvens.be] INFO: Scrape type for 1977607: 2
2026-03-24 22:48:51 [ayvens.be] INFO: Extracting data for car ID: 1977607
2026-03-24 22:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607
2026-03-24 22:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040d6a37-0b66-560e-b090-0f631aedcd26 with scrape type 2
2026-03-24 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 040d6a37-0b66-560e-b090-0f631aedcd26 with scrape type 2
2026-03-24 22:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 040d6a37-0b66-560e-b090-0f631aedcd26, identifier: 1977607
2026-03-24 22:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607
2026-03-24 22:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607
2026-03-24 22:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607 to the API
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '040d6a37-0b66-560e-b090-0f631aedcd26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 174382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.5 BLUEHDI 130 S&S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977607%27 HTTP/1.1" 200 None
2026-03-24 22:48:51 [ayvens.be] INFO: Saving data for 1977607: {'auction_closing_time': 1774600200.0, 'created_time': 1774306071.071824, 'last_price_update_time': 1774392531.400362}
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977607') HTTP/1.1" 204 0
2026-03-24 22:48:51 [ayvens.be] INFO: Found listing with ID: 1977608
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977608%27 HTTP/1.1" 200 None
2026-03-24 22:48:51 [ayvens.be] INFO: Scrape type for 1977608: 2
2026-03-24 22:48:51 [ayvens.be] INFO: Extracting data for car ID: 1977608
2026-03-24 22:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608
2026-03-24 22:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260a2c51-3acb-5bbf-942b-982a18ca0c65 with scrape type 2
2026-03-24 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 260a2c51-3acb-5bbf-942b-982a18ca0c65 with scrape type 2
2026-03-24 22:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 260a2c51-3acb-5bbf-942b-982a18ca0c65, identifier: 1977608
2026-03-24 22:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608
2026-03-24 22:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608
2026-03-24 22:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608 to the API
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '260a2c51-3acb-5bbf-942b-982a18ca0c65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3-serie',
 'odometer': 63063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3-serie 2.0 316DA (90KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 316DA (90KW) BERLINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977608%27 HTTP/1.1" 200 None
2026-03-24 22:48:51 [ayvens.be] INFO: Saving data for 1977608: {'auction_closing_time': 1774600200.0, 'created_time': 1774306072.397655, 'last_price_update_time': 1774392531.776963}
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977608') HTTP/1.1" 204 0
2026-03-24 22:48:51 [ayvens.be] INFO: Found listing with ID: 1977609
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977609%27 HTTP/1.1" 200 None
2026-03-24 22:48:51 [ayvens.be] INFO: Scrape type for 1977609: 2
2026-03-24 22:48:51 [ayvens.be] INFO: Extracting data for car ID: 1977609
2026-03-24 22:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609
2026-03-24 22:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37431d50-cf72-5885-afd9-523d39342c72 with scrape type 2
2026-03-24 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37431d50-cf72-5885-afd9-523d39342c72 with scrape type 2
2026-03-24 22:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 37431d50-cf72-5885-afd9-523d39342c72, identifier: 1977609
2026-03-24 22:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609
2026-03-24 22:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609
2026-03-24 22:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609 to the API
2026-03-24 22:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '37431d50-cf72-5885-afd9-523d39342c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-NIRO',
 'odometer': 55590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-NIRO 64 kWh More',
 'transmission': 'automatic',
 'trim': '64 kWh More',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977609%27 HTTP/1.1" 200 None
2026-03-24 22:48:52 [ayvens.be] INFO: Saving data for 1977609: {'auction_closing_time': 1774600200.0, 'created_time': 1774306073.918109, 'last_price_update_time': 1774392532.163231}
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977609') HTTP/1.1" 204 0
2026-03-24 22:48:52 [ayvens.be] INFO: Found listing with ID: 1977610
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977610%27 HTTP/1.1" 200 None
2026-03-24 22:48:52 [ayvens.be] INFO: Scrape type for 1977610: 2
2026-03-24 22:48:52 [ayvens.be] INFO: Extracting data for car ID: 1977610
2026-03-24 22:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610
2026-03-24 22:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dba49b41-167c-5510-a7f6-344af3ca5feb with scrape type 2
2026-03-24 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dba49b41-167c-5510-a7f6-344af3ca5feb with scrape type 2
2026-03-24 22:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dba49b41-167c-5510-a7f6-344af3ca5feb, identifier: 1977610
2026-03-24 22:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610
2026-03-24 22:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610
2026-03-24 22:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610 to the API
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'dba49b41-167c-5510-a7f6-344af3ca5feb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60 DIESEL - 2017',
 'odometer': 205744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 DIESEL - 2017 2.0 D4 Momentum Pro Geartronic AdBlue',
 'transmission': 'automatic',
 'trim': '2.0 D4 Momentum Pro Geartronic AdBlue',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977610%27 HTTP/1.1" 200 None
2026-03-24 22:48:52 [ayvens.be] INFO: Saving data for 1977610: {'auction_closing_time': 1774600200.0, 'created_time': 1774306075.481879, 'last_price_update_time': 1774392532.533813}
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977610') HTTP/1.1" 204 0
2026-03-24 22:48:52 [ayvens.be] INFO: Found listing with ID: 1977611
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977611%27 HTTP/1.1" 200 None
2026-03-24 22:48:52 [ayvens.be] INFO: Scrape type for 1977611: 2
2026-03-24 22:48:52 [ayvens.be] INFO: Extracting data for car ID: 1977611
2026-03-24 22:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611
2026-03-24 22:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898dea59-cd2d-56de-8a0c-7be8a52134c9 with scrape type 2
2026-03-24 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 898dea59-cd2d-56de-8a0c-7be8a52134c9 with scrape type 2
2026-03-24 22:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 898dea59-cd2d-56de-8a0c-7be8a52134c9, identifier: 1977611
2026-03-24 22:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611
2026-03-24 22:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611
2026-03-24 22:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611 to the API
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '898dea59-cd2d-56de-8a0c-7be8a52134c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 135672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977611%27 HTTP/1.1" 200 None
2026-03-24 22:48:53 [ayvens.be] INFO: Saving data for 1977611: {'auction_closing_time': 1774600200.0, 'created_time': 1774306077.471025, 'last_price_update_time': 1774392533.003717}
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977611') HTTP/1.1" 204 0
2026-03-24 22:48:53 [ayvens.be] INFO: Found listing with ID: 1977612
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977612%27 HTTP/1.1" 200 None
2026-03-24 22:48:53 [ayvens.be] INFO: Scrape type for 1977612: 2
2026-03-24 22:48:53 [ayvens.be] INFO: Extracting data for car ID: 1977612
2026-03-24 22:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612
2026-03-24 22:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0042e16-49d4-5186-91df-19abf8b1b381 with scrape type 2
2026-03-24 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0042e16-49d4-5186-91df-19abf8b1b381 with scrape type 2
2026-03-24 22:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a0042e16-49d4-5186-91df-19abf8b1b381, identifier: 1977612
2026-03-24 22:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612
2026-03-24 22:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612
2026-03-24 22:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612 to the API
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a0042e16-49d4-5186-91df-19abf8b1b381',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 61897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977612%27 HTTP/1.1" 200 None
2026-03-24 22:48:53 [ayvens.be] INFO: Saving data for 1977612: {'auction_closing_time': 1774600200.0, 'created_time': 1774306079.344922, 'last_price_update_time': 1774392533.408035}
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977612') HTTP/1.1" 204 0
2026-03-24 22:48:53 [ayvens.be] INFO: Found listing with ID: 1977613
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977613%27 HTTP/1.1" 200 None
2026-03-24 22:48:53 [ayvens.be] INFO: Scrape type for 1977613: 2
2026-03-24 22:48:53 [ayvens.be] INFO: Extracting data for car ID: 1977613
2026-03-24 22:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613
2026-03-24 22:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660c9326-32a1-5c05-955c-dfcb85917614 with scrape type 2
2026-03-24 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 660c9326-32a1-5c05-955c-dfcb85917614 with scrape type 2
2026-03-24 22:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 660c9326-32a1-5c05-955c-dfcb85917614, identifier: 1977613
2026-03-24 22:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613
2026-03-24 22:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613
2026-03-24 22:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613 to the API
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '660c9326-32a1-5c05-955c-dfcb85917614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 107231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977613%27 HTTP/1.1" 200 None
2026-03-24 22:48:53 [ayvens.be] INFO: Saving data for 1977613: {'auction_closing_time': 1774600200.0, 'created_time': 1774306079.898043, 'last_price_update_time': 1774392533.774053}
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977613') HTTP/1.1" 204 0
2026-03-24 22:48:53 [ayvens.be] INFO: Found listing with ID: 1977614
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977614%27 HTTP/1.1" 200 None
2026-03-24 22:48:53 [ayvens.be] INFO: Scrape type for 1977614: 2
2026-03-24 22:48:53 [ayvens.be] INFO: Extracting data for car ID: 1977614
2026-03-24 22:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614
2026-03-24 22:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7cf7938-333f-5878-9a82-a92f0466ca26 with scrape type 2
2026-03-24 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7cf7938-333f-5878-9a82-a92f0466ca26 with scrape type 2
2026-03-24 22:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c7cf7938-333f-5878-9a82-a92f0466ca26, identifier: 1977614
2026-03-24 22:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614
2026-03-24 22:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614
2026-03-24 22:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614 to the API
2026-03-24 22:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c7cf7938-333f-5878-9a82-a92f0466ca26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 132687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977614%27 HTTP/1.1" 200 None
2026-03-24 22:48:54 [ayvens.be] INFO: Saving data for 1977614: {'auction_closing_time': 1774600200.0, 'created_time': 1774306082.02561, 'last_price_update_time': 1774392534.136875}
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977614') HTTP/1.1" 204 0
2026-03-24 22:48:54 [ayvens.be] INFO: Found listing with ID: 1977615
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977615%27 HTTP/1.1" 200 None
2026-03-24 22:48:54 [ayvens.be] INFO: Scrape type for 1977615: 2
2026-03-24 22:48:54 [ayvens.be] INFO: Extracting data for car ID: 1977615
2026-03-24 22:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615
2026-03-24 22:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cd0f094-d194-52c0-8bec-863643a930fd with scrape type 2
2026-03-24 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cd0f094-d194-52c0-8bec-863643a930fd with scrape type 2
2026-03-24 22:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cd0f094-d194-52c0-8bec-863643a930fd, identifier: 1977615
2026-03-24 22:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615
2026-03-24 22:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615
2026-03-24 22:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615 to the API
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0cd0f094-d194-52c0-8bec-863643a930fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE A DIESEL (W177)',
 'odometer': 145148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE A DIESEL (W177) A 180 d Business Solution',
 'transmission': 'automatic',
 'trim': 'A 180 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977615%27 HTTP/1.1" 200 None
2026-03-24 22:48:54 [ayvens.be] INFO: Saving data for 1977615: {'auction_closing_time': 1774600200.0, 'created_time': 1774306083.961453, 'last_price_update_time': 1774392534.577912}
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977615') HTTP/1.1" 204 0
2026-03-24 22:48:54 [ayvens.be] INFO: Found listing with ID: 1977616
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977616%27 HTTP/1.1" 200 None
2026-03-24 22:48:54 [ayvens.be] INFO: Scrape type for 1977616: 2
2026-03-24 22:48:54 [ayvens.be] INFO: Extracting data for car ID: 1977616
2026-03-24 22:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616
2026-03-24 22:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cff5db06-d1e9-56ee-834a-4d8989a81150 with scrape type 2
2026-03-24 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cff5db06-d1e9-56ee-834a-4d8989a81150 with scrape type 2
2026-03-24 22:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cff5db06-d1e9-56ee-834a-4d8989a81150, identifier: 1977616
2026-03-24 22:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616
2026-03-24 22:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616
2026-03-24 22:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616 to the API
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'cff5db06-d1e9-56ee-834a-4d8989a81150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 131945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'transmission': 'automatic',
 'trim': '2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977616%27 HTTP/1.1" 200 None
2026-03-24 22:48:54 [ayvens.be] INFO: Saving data for 1977616: {'auction_closing_time': 1774600200.0, 'created_time': 1774306085.891845, 'last_price_update_time': 1774392534.944238}
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977616') HTTP/1.1" 204 0
2026-03-24 22:48:54 [ayvens.be] INFO: Found listing with ID: 1977617
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977617%27 HTTP/1.1" 200 None
2026-03-24 22:48:54 [ayvens.be] INFO: Scrape type for 1977617: 2
2026-03-24 22:48:54 [ayvens.be] INFO: Extracting data for car ID: 1977617
2026-03-24 22:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617
2026-03-24 22:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with scrape type 2
2026-03-24 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with scrape type 2
2026-03-24 22:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f4b029cf-ea7c-5649-ad7e-c5b21adfef70, identifier: 1977617
2026-03-24 22:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617
2026-03-24 22:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617
2026-03-24 22:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617 to the API
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'f4b029cf-ea7c-5649-ad7e-c5b21adfef70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MUSTANG MACH-E',
 'odometer': 151650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MUSTANG MACH-E BEV 99KWH 216KW EXTENDED RANGE RWD',
 'transmission': 'automatic',
 'trim': 'BEV 99KWH 216KW EXTENDED RANGE RWD',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977617%27 HTTP/1.1" 200 None
2026-03-24 22:48:55 [ayvens.be] INFO: Saving data for 1977617: {'auction_closing_time': 1774600200.0, 'created_time': 1774306086.945757, 'last_price_update_time': 1774392535.329882}
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977617') HTTP/1.1" 204 0
2026-03-24 22:48:55 [ayvens.be] INFO: Found listing with ID: 1977618
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977618%27 HTTP/1.1" 200 None
2026-03-24 22:48:55 [ayvens.be] INFO: Scrape type for 1977618: 2
2026-03-24 22:48:55 [ayvens.be] INFO: Extracting data for car ID: 1977618
2026-03-24 22:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618
2026-03-24 22:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with scrape type 2
2026-03-24 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with scrape type 2
2026-03-24 22:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac, identifier: 1977618
2026-03-24 22:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618
2026-03-24 22:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618
2026-03-24 22:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618 to the API
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '328e7d27-a6ce-5f45-b17c-b9a4da4041ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO DIESEL - 2018',
 'odometer': 101835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO DIESEL - 2018 1.6 TDi SCR Comfortline (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.6 TDi SCR Comfortline (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977618%27 HTTP/1.1" 200 None
2026-03-24 22:48:55 [ayvens.be] INFO: Saving data for 1977618: {'auction_closing_time': 1774600200.0, 'created_time': 1774306088.303919, 'last_price_update_time': 1774392535.715299}
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977618') HTTP/1.1" 204 0
2026-03-24 22:48:55 [ayvens.be] INFO: Found listing with ID: 1977619
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977619%27 HTTP/1.1" 200 None
2026-03-24 22:48:55 [ayvens.be] INFO: Scrape type for 1977619: 2
2026-03-24 22:48:55 [ayvens.be] INFO: Extracting data for car ID: 1977619
2026-03-24 22:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619
2026-03-24 22:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8adeea2f-7916-56ea-a4b6-a301ec72b012 with scrape type 2
2026-03-24 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8adeea2f-7916-56ea-a4b6-a301ec72b012 with scrape type 2
2026-03-24 22:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8adeea2f-7916-56ea-a4b6-a301ec72b012, identifier: 1977619
2026-03-24 22:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619
2026-03-24 22:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619
2026-03-24 22:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619 to the API
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8adeea2f-7916-56ea-a4b6-a301ec72b012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 36989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977619%27 HTTP/1.1" 200 None
2026-03-24 22:48:56 [ayvens.be] INFO: Saving data for 1977619: {'auction_closing_time': 1774600200.0, 'created_time': 1774306089.702715, 'last_price_update_time': 1774392536.09659}
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977619') HTTP/1.1" 204 0
2026-03-24 22:48:56 [ayvens.be] INFO: Found listing with ID: 1977620
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977620%27 HTTP/1.1" 200 None
2026-03-24 22:48:56 [ayvens.be] INFO: Scrape type for 1977620: 2
2026-03-24 22:48:56 [ayvens.be] INFO: Extracting data for car ID: 1977620
2026-03-24 22:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620
2026-03-24 22:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e4ced7-c0d3-519f-83af-10ab6ba84912 with scrape type 2
2026-03-24 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e4ced7-c0d3-519f-83af-10ab6ba84912 with scrape type 2
2026-03-24 22:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b4e4ced7-c0d3-519f-83af-10ab6ba84912, identifier: 1977620
2026-03-24 22:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620
2026-03-24 22:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620
2026-03-24 22:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620 to the API
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b4e4ced7-c0d3-519f-83af-10ab6ba84912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 44894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977620%27 HTTP/1.1" 200 None
2026-03-24 22:48:56 [ayvens.be] INFO: Saving data for 1977620: {'auction_closing_time': 1774600200.0, 'created_time': 1774306091.653171, 'last_price_update_time': 1774392536.504762}
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977620') HTTP/1.1" 204 0
2026-03-24 22:48:56 [ayvens.be] INFO: Found listing with ID: 1977621
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977621%27 HTTP/1.1" 200 None
2026-03-24 22:48:56 [ayvens.be] INFO: Scrape type for 1977621: 2
2026-03-24 22:48:56 [ayvens.be] INFO: Extracting data for car ID: 1977621
2026-03-24 22:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621
2026-03-24 22:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with scrape type 2
2026-03-24 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with scrape type 2
2026-03-24 22:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1c5d34e1-90e0-5364-948b-2d3368cc1c27, identifier: 1977621
2026-03-24 22:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621
2026-03-24 22:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621
2026-03-24 22:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621 to the API
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1c5d34e1-90e0-5364-948b-2d3368cc1c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 50647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PURETECH 96KW S-S ALLURE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S ALLURE PACK',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977621%27 HTTP/1.1" 200 None
2026-03-24 22:48:56 [ayvens.be] INFO: Saving data for 1977621: {'auction_closing_time': 1774600200.0, 'created_time': 1774306092.658344, 'last_price_update_time': 1774392536.913941}
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977621') HTTP/1.1" 204 0
2026-03-24 22:48:57 [ayvens.be] INFO: Found listing with ID: 1977622
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977622%27 HTTP/1.1" 200 None
2026-03-24 22:48:57 [ayvens.be] INFO: Scrape type for 1977622: 2
2026-03-24 22:48:57 [ayvens.be] INFO: Extracting data for car ID: 1977622
2026-03-24 22:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622
2026-03-24 22:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17482517-12b1-53dd-8638-ca59e46bd45c with scrape type 2
2026-03-24 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17482517-12b1-53dd-8638-ca59e46bd45c with scrape type 2
2026-03-24 22:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17482517-12b1-53dd-8638-ca59e46bd45c, identifier: 1977622
2026-03-24 22:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622
2026-03-24 22:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622
2026-03-24 22:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622 to the API
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '17482517-12b1-53dd-8638-ca59e46bd45c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 115692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977622%27 HTTP/1.1" 200 None
2026-03-24 22:48:57 [ayvens.be] INFO: Saving data for 1977622: {'auction_closing_time': 1774600200.0, 'created_time': 1774306095.365105, 'last_price_update_time': 1774392537.376232}
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977622') HTTP/1.1" 204 0
2026-03-24 22:48:57 [ayvens.be] INFO: Found listing with ID: 1977623
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977623%27 HTTP/1.1" 200 None
2026-03-24 22:48:57 [ayvens.be] INFO: Scrape type for 1977623: 2
2026-03-24 22:48:57 [ayvens.be] INFO: Extracting data for car ID: 1977623
2026-03-24 22:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623
2026-03-24 22:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 395845a7-e6de-568b-922f-6834cd836242 with scrape type 2
2026-03-24 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 395845a7-e6de-568b-922f-6834cd836242 with scrape type 2
2026-03-24 22:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 395845a7-e6de-568b-922f-6834cd836242, identifier: 1977623
2026-03-24 22:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623
2026-03-24 22:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623
2026-03-24 22:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623 to the API
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '395845a7-e6de-568b-922f-6834cd836242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 159350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977623%27 HTTP/1.1" 200 None
2026-03-24 22:48:57 [ayvens.be] INFO: Saving data for 1977623: {'auction_closing_time': 1774600200.0, 'created_time': 1774306096.610145, 'last_price_update_time': 1774392537.774266}
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977623') HTTP/1.1" 204 0
2026-03-24 22:48:57 [ayvens.be] INFO: Found listing with ID: 1977624
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977624%27 HTTP/1.1" 200 None
2026-03-24 22:48:57 [ayvens.be] INFO: Scrape type for 1977624: 2
2026-03-24 22:48:57 [ayvens.be] INFO: Extracting data for car ID: 1977624
2026-03-24 22:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624
2026-03-24 22:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9098dd5f-54ad-563a-b02b-c3e0efe05603 with scrape type 2
2026-03-24 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9098dd5f-54ad-563a-b02b-c3e0efe05603 with scrape type 2
2026-03-24 22:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9098dd5f-54ad-563a-b02b-c3e0efe05603, identifier: 1977624
2026-03-24 22:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624
2026-03-24 22:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624
2026-03-24 22:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624 to the API
2026-03-24 22:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '9098dd5f-54ad-563a-b02b-c3e0efe05603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 35503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA 1.0 IG-T ACENTA',
 'transmission': 'manual',
 'trim': '1.0 IG-T ACENTA',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977624%27 HTTP/1.1" 200 None
2026-03-24 22:48:58 [ayvens.be] INFO: Saving data for 1977624: {'auction_closing_time': 1774600200.0, 'created_time': 1774306098.176585, 'last_price_update_time': 1774392538.164314}
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977624') HTTP/1.1" 204 0
2026-03-24 22:48:58 [ayvens.be] INFO: Found listing with ID: 1977625
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977625%27 HTTP/1.1" 200 None
2026-03-24 22:48:58 [ayvens.be] INFO: Scrape type for 1977625: 2
2026-03-24 22:48:58 [ayvens.be] INFO: Extracting data for car ID: 1977625
2026-03-24 22:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625
2026-03-24 22:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cae6efa-1e19-5809-96ef-b55cab49d096 with scrape type 2
2026-03-24 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cae6efa-1e19-5809-96ef-b55cab49d096 with scrape type 2
2026-03-24 22:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cae6efa-1e19-5809-96ef-b55cab49d096, identifier: 1977625
2026-03-24 22:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625
2026-03-24 22:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625
2026-03-24 22:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625 to the API
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0cae6efa-1e19-5809-96ef-b55cab49d096',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER 300 FOU LWB DSL - 201',
 'odometer': 97532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 300 FOU LWB DSL - 201 314 2.1 CDI L3H2 RWD '
          'Functional',
 'transmission': 'manual',
 'trim': '314 2.1 CDI L3H2 RWD Functional',
 'vin': None,
 'year': 2020}
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977625%27 HTTP/1.1" 200 None
2026-03-24 22:48:58 [ayvens.be] INFO: Saving data for 1977625: {'auction_closing_time': 1774600200.0, 'created_time': 1774306099.785612, 'last_price_update_time': 1774392538.540973}
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977625') HTTP/1.1" 204 0
2026-03-24 22:48:58 [ayvens.be] INFO: Found listing with ID: 1977626
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977626%27 HTTP/1.1" 200 None
2026-03-24 22:48:58 [ayvens.be] INFO: Scrape type for 1977626: 2
2026-03-24 22:48:58 [ayvens.be] INFO: Extracting data for car ID: 1977626
2026-03-24 22:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626
2026-03-24 22:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4571c8eb-bd65-57af-a509-c1147d519ef0 with scrape type 2
2026-03-24 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4571c8eb-bd65-57af-a509-c1147d519ef0 with scrape type 2
2026-03-24 22:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4571c8eb-bd65-57af-a509-c1147d519ef0, identifier: 1977626
2026-03-24 22:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626
2026-03-24 22:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626
2026-03-24 22:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626 to the API
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4571c8eb-bd65-57af-a509-c1147d519ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D",
 'odometer': 52057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D 1.0 T-GDI PULSE",
 'transmission': 'manual',
 'trim': '1.0 T-GDI PULSE',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977626%27 HTTP/1.1" 200 None
2026-03-24 22:48:58 [ayvens.be] INFO: Saving data for 1977626: {'auction_closing_time': 1774600200.0, 'created_time': 1774306101.028811, 'last_price_update_time': 1774392538.953981}
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977626') HTTP/1.1" 204 0
2026-03-24 22:48:58 [ayvens.be] INFO: Found listing with ID: 1977627
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977627%27 HTTP/1.1" 200 None
2026-03-24 22:48:58 [ayvens.be] INFO: Scrape type for 1977627: 2
2026-03-24 22:48:58 [ayvens.be] INFO: Extracting data for car ID: 1977627
2026-03-24 22:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627
2026-03-24 22:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d43feb-66a5-5782-affb-8345854bfbde with scrape type 2
2026-03-24 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d43feb-66a5-5782-affb-8345854bfbde with scrape type 2
2026-03-24 22:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62d43feb-66a5-5782-affb-8345854bfbde, identifier: 1977627
2026-03-24 22:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627
2026-03-24 22:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627
2026-03-24 22:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627 to the API
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '62d43feb-66a5-5782-affb-8345854bfbde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 64632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977627%27 HTTP/1.1" 200 None
2026-03-24 22:48:59 [ayvens.be] INFO: Saving data for 1977627: {'auction_closing_time': 1774600200.0, 'created_time': 1774306103.643748, 'last_price_update_time': 1774392539.320798}
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977627') HTTP/1.1" 204 0
2026-03-24 22:48:59 [ayvens.be] INFO: Found listing with ID: 1977628
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977628%27 HTTP/1.1" 200 None
2026-03-24 22:48:59 [ayvens.be] INFO: Scrape type for 1977628: 2
2026-03-24 22:48:59 [ayvens.be] INFO: Extracting data for car ID: 1977628
2026-03-24 22:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628
2026-03-24 22:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with scrape type 2
2026-03-24 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with scrape type 2
2026-03-24 22:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70, identifier: 1977628
2026-03-24 22:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628
2026-03-24 22:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628
2026-03-24 22:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628 to the API
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c2c941d7-d350-5adb-8ad0-3b8b1dda6c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 59595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.5 TSI 110KW CLEVER+',
 'transmission': 'manual',
 'trim': '1.5 TSI 110KW CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977628%27 HTTP/1.1" 200 None
2026-03-24 22:48:59 [ayvens.be] INFO: Saving data for 1977628: {'auction_closing_time': 1774600200.0, 'created_time': 1774306104.818584, 'last_price_update_time': 1774392539.6953}
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977628') HTTP/1.1" 204 0
2026-03-24 22:48:59 [ayvens.be] INFO: Found listing with ID: 1977629
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977629%27 HTTP/1.1" 200 None
2026-03-24 22:49:00 [ayvens.be] INFO: Scrape type for 1977629: 2
2026-03-24 22:49:00 [ayvens.be] INFO: Extracting data for car ID: 1977629
2026-03-24 22:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629
2026-03-24 22:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04681dfe-2f8c-578e-8116-eed572210b54 with scrape type 2
2026-03-24 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04681dfe-2f8c-578e-8116-eed572210b54 with scrape type 2
2026-03-24 22:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 04681dfe-2f8c-578e-8116-eed572210b54, identifier: 1977629
2026-03-24 22:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629
2026-03-24 22:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629
2026-03-24 22:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629 to the API
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '04681dfe-2f8c-578e-8116-eed572210b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 49804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 B 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977629%27 HTTP/1.1" 200 None
2026-03-24 22:49:00 [ayvens.be] INFO: Saving data for 1977629: {'auction_closing_time': 1774600200.0, 'created_time': 1774306106.15014, 'last_price_update_time': 1774392540.395103}
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977629') HTTP/1.1" 204 0
2026-03-24 22:49:00 [ayvens.be] INFO: Found listing with ID: 1977630
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977630%27 HTTP/1.1" 200 None
2026-03-24 22:49:00 [ayvens.be] INFO: Scrape type for 1977630: 2
2026-03-24 22:49:00 [ayvens.be] INFO: Extracting data for car ID: 1977630
2026-03-24 22:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630
2026-03-24 22:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with scrape type 2
2026-03-24 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with scrape type 2
2026-03-24 22:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b, identifier: 1977630
2026-03-24 22:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630
2026-03-24 22:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630
2026-03-24 22:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630 to the API
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '91e98abb-e4ba-5a6c-a670-45271e3f4d8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'IVECO',
 'model': 'DAILY',
 'odometer': 164400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'IVECO DAILY IVECO Daily 50C18H V-P-3.0 Turbo (4100)',
 'transmission': 'manual',
 'trim': 'IVECO Daily 50C18H V-P-3.0 Turbo (4100)',
 'vin': None,
 'year': 2019}
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977630%27 HTTP/1.1" 200 None
2026-03-24 22:49:00 [ayvens.be] INFO: Saving data for 1977630: {'auction_closing_time': 1774600200.0, 'created_time': 1774306107.42825, 'last_price_update_time': 1774392540.774508}
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977630') HTTP/1.1" 204 0
2026-03-24 22:49:00 [ayvens.be] INFO: Found listing with ID: 1977631
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977631%27 HTTP/1.1" 200 None
2026-03-24 22:49:00 [ayvens.be] INFO: Scrape type for 1977631: 2
2026-03-24 22:49:00 [ayvens.be] INFO: Extracting data for car ID: 1977631
2026-03-24 22:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631
2026-03-24 22:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe5789cb-bdae-502d-981e-e67eb4c6ad8f with scrape type 2
2026-03-24 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe5789cb-bdae-502d-981e-e67eb4c6ad8f with scrape type 2
2026-03-24 22:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe5789cb-bdae-502d-981e-e67eb4c6ad8f, identifier: 1977631
2026-03-24 22:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631
2026-03-24 22:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631
2026-03-24 22:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631 to the API
2026-03-24 22:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fe5789cb-bdae-502d-981e-e67eb4c6ad8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 105463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM PRO',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM PRO',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977631%27 HTTP/1.1" 200 None
2026-03-24 22:49:01 [ayvens.be] INFO: Saving data for 1977631: {'auction_closing_time': 1774600200.0, 'created_time': 1774306109.425923, 'last_price_update_time': 1774392541.164078}
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977631') HTTP/1.1" 204 0
2026-03-24 22:49:01 [ayvens.be] INFO: Found listing with ID: 1977632
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977632%27 HTTP/1.1" 200 None
2026-03-24 22:49:01 [ayvens.be] INFO: Scrape type for 1977632: 2
2026-03-24 22:49:01 [ayvens.be] INFO: Extracting data for car ID: 1977632
2026-03-24 22:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632
2026-03-24 22:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db717a7-54d5-52a2-9622-9c38b840ce30 with scrape type 2
2026-03-24 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db717a7-54d5-52a2-9622-9c38b840ce30 with scrape type 2
2026-03-24 22:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3db717a7-54d5-52a2-9622-9c38b840ce30, identifier: 1977632
2026-03-24 22:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632
2026-03-24 22:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632
2026-03-24 22:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632 to the API
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3db717a7-54d5-52a2-9622-9c38b840ce30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 78533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977632%27 HTTP/1.1" 200 None
2026-03-24 22:49:01 [ayvens.be] INFO: Saving data for 1977632: {'auction_closing_time': 1774600200.0, 'created_time': 1774306111.757229, 'last_price_update_time': 1774392541.541601}
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977632') HTTP/1.1" 204 0
2026-03-24 22:49:01 [ayvens.be] INFO: Found listing with ID: 1977633
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977633%27 HTTP/1.1" 200 None
2026-03-24 22:49:01 [ayvens.be] INFO: Scrape type for 1977633: 2
2026-03-24 22:49:01 [ayvens.be] INFO: Extracting data for car ID: 1977633
2026-03-24 22:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633
2026-03-24 22:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1be1016-d29e-54f5-bd1a-d0214c12115e with scrape type 2
2026-03-24 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1be1016-d29e-54f5-bd1a-d0214c12115e with scrape type 2
2026-03-24 22:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a1be1016-d29e-54f5-bd1a-d0214c12115e, identifier: 1977633
2026-03-24 22:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633
2026-03-24 22:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633
2026-03-24 22:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633 to the API
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a1be1016-d29e-54f5-bd1a-d0214c12115e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 75629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S&S AUTO ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977633%27 HTTP/1.1" 200 None
2026-03-24 22:49:01 [ayvens.be] INFO: Saving data for 1977633: {'auction_closing_time': 1774600200.0, 'created_time': 1774306112.985921, 'last_price_update_time': 1774392541.996278}
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977633') HTTP/1.1" 204 0
2026-03-24 22:49:02 [ayvens.be] INFO: Found listing with ID: 1977634
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977634%27 HTTP/1.1" 200 None
2026-03-24 22:49:02 [ayvens.be] INFO: Scrape type for 1977634: 2
2026-03-24 22:49:02 [ayvens.be] INFO: Extracting data for car ID: 1977634
2026-03-24 22:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634
2026-03-24 22:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18014459-f58b-5111-9c13-67b4c82529c1 with scrape type 2
2026-03-24 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18014459-f58b-5111-9c13-67b4c82529c1 with scrape type 2
2026-03-24 22:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 18014459-f58b-5111-9c13-67b4c82529c1, identifier: 1977634
2026-03-24 22:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634
2026-03-24 22:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634
2026-03-24 22:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634 to the API
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '18014459-f58b-5111-9c13-67b4c82529c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MUSTANG MACH-E',
 'odometer': 131896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MUSTANG MACH-E BEV 99KWH 216KW EXTENDED RANGE RWD',
 'transmission': 'automatic',
 'trim': 'BEV 99KWH 216KW EXTENDED RANGE RWD',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977634%27 HTTP/1.1" 200 None
2026-03-24 22:49:02 [ayvens.be] INFO: Saving data for 1977634: {'auction_closing_time': 1774600200.0, 'created_time': 1774306114.134582, 'last_price_update_time': 1774392542.387134}
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977634') HTTP/1.1" 204 0
2026-03-24 22:49:02 [ayvens.be] INFO: Found listing with ID: 1977635
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977635%27 HTTP/1.1" 200 None
2026-03-24 22:49:02 [ayvens.be] INFO: Scrape type for 1977635: 2
2026-03-24 22:49:02 [ayvens.be] INFO: Extracting data for car ID: 1977635
2026-03-24 22:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635
2026-03-24 22:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71985439-3ef0-5027-9dad-d60a2915edf4 with scrape type 2
2026-03-24 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71985439-3ef0-5027-9dad-d60a2915edf4 with scrape type 2
2026-03-24 22:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71985439-3ef0-5027-9dad-d60a2915edf4, identifier: 1977635
2026-03-24 22:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635
2026-03-24 22:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635
2026-03-24 22:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635 to the API
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '71985439-3ef0-5027-9dad-d60a2915edf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 DIESEL - 2018',
 'odometer': 191014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 DIESEL - 2018 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977635%27 HTTP/1.1" 200 None
2026-03-24 22:49:02 [ayvens.be] INFO: Saving data for 1977635: {'auction_closing_time': 1774600200.0, 'created_time': 1774306116.570474, 'last_price_update_time': 1774392542.80822}
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977635') HTTP/1.1" 204 0
2026-03-24 22:49:02 [ayvens.be] INFO: Found listing with ID: 1977636
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977636%27 HTTP/1.1" 200 None
2026-03-24 22:49:02 [ayvens.be] INFO: Scrape type for 1977636: 2
2026-03-24 22:49:02 [ayvens.be] INFO: Extracting data for car ID: 1977636
2026-03-24 22:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636
2026-03-24 22:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with scrape type 2
2026-03-24 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with scrape type 2
2026-03-24 22:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1, identifier: 1977636
2026-03-24 22:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636
2026-03-24 22:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636
2026-03-24 22:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636 to the API
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0e5fb78d-d2d1-5307-ae51-85f87434b7c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 49405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977636%27 HTTP/1.1" 200 None
2026-03-24 22:49:03 [ayvens.be] INFO: Saving data for 1977636: {'auction_closing_time': 1774600200.0, 'created_time': 1774306117.805193, 'last_price_update_time': 1774392543.179545}
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977636') HTTP/1.1" 204 0
2026-03-24 22:49:03 [ayvens.be] INFO: Found listing with ID: 1977637
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977637%27 HTTP/1.1" 200 None
2026-03-24 22:49:03 [ayvens.be] INFO: Scrape type for 1977637: 2
2026-03-24 22:49:03 [ayvens.be] INFO: Extracting data for car ID: 1977637
2026-03-24 22:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637
2026-03-24 22:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33c9a9fb-7084-50f0-a4e6-835fba729daa with scrape type 2
2026-03-24 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33c9a9fb-7084-50f0-a4e6-835fba729daa with scrape type 2
2026-03-24 22:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33c9a9fb-7084-50f0-a4e6-835fba729daa, identifier: 1977637
2026-03-24 22:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637
2026-03-24 22:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637
2026-03-24 22:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637 to the API
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '33c9a9fb-7084-50f0-a4e6-835fba729daa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 DIESEL - 2019',
 'odometer': 161246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 DIESEL - 2019 320 d AdBlue',
 'transmission': 'manual',
 'trim': '320 d AdBlue',
 'vin': None,
 'year': 2019}
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977637%27 HTTP/1.1" 200 None
2026-03-24 22:49:03 [ayvens.be] INFO: Saving data for 1977637: {'auction_closing_time': 1774600200.0, 'created_time': 1774306120.415893, 'last_price_update_time': 1774392543.544336}
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977637') HTTP/1.1" 204 0
2026-03-24 22:49:03 [ayvens.be] INFO: Found listing with ID: 1977638
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977638%27 HTTP/1.1" 200 None
2026-03-24 22:49:03 [ayvens.be] INFO: Scrape type for 1977638: 2
2026-03-24 22:49:03 [ayvens.be] INFO: Extracting data for car ID: 1977638
2026-03-24 22:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638
2026-03-24 22:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc1ac4d-b143-5693-b563-12d0a0856b05 with scrape type 2
2026-03-24 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc1ac4d-b143-5693-b563-12d0a0856b05 with scrape type 2
2026-03-24 22:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2bc1ac4d-b143-5693-b563-12d0a0856b05, identifier: 1977638
2026-03-24 22:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638
2026-03-24 22:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638
2026-03-24 22:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638 to the API
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '2bc1ac4d-b143-5693-b563-12d0a0856b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 118853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977638%27 HTTP/1.1" 200 None
2026-03-24 22:49:04 [ayvens.be] INFO: Saving data for 1977638: {'auction_closing_time': 1774600200.0, 'created_time': 1774306122.016568, 'last_price_update_time': 1774392544.000046}
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977638') HTTP/1.1" 204 0
2026-03-24 22:49:04 [ayvens.be] INFO: Found listing with ID: 1977639
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977639%27 HTTP/1.1" 200 None
2026-03-24 22:49:04 [ayvens.be] INFO: Scrape type for 1977639: 2
2026-03-24 22:49:04 [ayvens.be] INFO: Extracting data for car ID: 1977639
2026-03-24 22:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639
2026-03-24 22:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with scrape type 2
2026-03-24 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with scrape type 2
2026-03-24 22:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3, identifier: 1977639
2026-03-24 22:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639
2026-03-24 22:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639
2026-03-24 22:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639 to the API
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Golf',
 'odometer': 164501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Golf 1.5 TGI TRENDLINE DSG',
 'transmission': 'automatic',
 'trim': '1.5 TGI TRENDLINE DSG',
 'vin': None,
 'year': 2019}
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977639%27 HTTP/1.1" 200 None
2026-03-24 22:49:04 [ayvens.be] INFO: Saving data for 1977639: {'auction_closing_time': 1774600200.0, 'created_time': 1774306123.612035, 'last_price_update_time': 1774392544.389735}
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977639') HTTP/1.1" 204 0
2026-03-24 22:49:04 [ayvens.be] INFO: Found listing with ID: 1977640
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977640%27 HTTP/1.1" 200 None
2026-03-24 22:49:04 [ayvens.be] INFO: Scrape type for 1977640: 2
2026-03-24 22:49:04 [ayvens.be] INFO: Extracting data for car ID: 1977640
2026-03-24 22:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640
2026-03-24 22:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c610f8e2-beb2-57b7-a175-40a50bb05d37 with scrape type 2
2026-03-24 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c610f8e2-beb2-57b7-a175-40a50bb05d37 with scrape type 2
2026-03-24 22:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c610f8e2-beb2-57b7-a175-40a50bb05d37, identifier: 1977640
2026-03-24 22:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640
2026-03-24 22:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640
2026-03-24 22:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640 to the API
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c610f8e2-beb2-57b7-a175-40a50bb05d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 113575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977640%27 HTTP/1.1" 200 None
2026-03-24 22:49:04 [ayvens.be] INFO: Saving data for 1977640: {'auction_closing_time': 1774600200.0, 'created_time': 1774306125.152589, 'last_price_update_time': 1774392544.795127}
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977640') HTTP/1.1" 204 0
2026-03-24 22:49:04 [ayvens.be] INFO: Found listing with ID: 1977641
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977641%27 HTTP/1.1" 200 None
2026-03-24 22:49:04 [ayvens.be] INFO: Scrape type for 1977641: 2
2026-03-24 22:49:04 [ayvens.be] INFO: Extracting data for car ID: 1977641
2026-03-24 22:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641
2026-03-24 22:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03aecc3-08a0-538e-8586-940b044c7f49 with scrape type 2
2026-03-24 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03aecc3-08a0-538e-8586-940b044c7f49 with scrape type 2
2026-03-24 22:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b03aecc3-08a0-538e-8586-940b044c7f49, identifier: 1977641
2026-03-24 22:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641
2026-03-24 22:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641
2026-03-24 22:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641 to the API
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b03aecc3-08a0-538e-8586-940b044c7f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 43010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 80 GRAND CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 80 GRAND CONFORT',
 'vin': None,
 'year': 2020}
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977641%27 HTTP/1.1" 200 None
2026-03-24 22:49:05 [ayvens.be] INFO: Saving data for 1977641: {'auction_closing_time': 1774600200.0, 'created_time': 1774306127.212522, 'last_price_update_time': 1774392545.17398}
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977641') HTTP/1.1" 204 0
2026-03-24 22:49:05 [ayvens.be] INFO: Found listing with ID: 1977642
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977642%27 HTTP/1.1" 200 None
2026-03-24 22:49:05 [ayvens.be] INFO: Scrape type for 1977642: 2
2026-03-24 22:49:05 [ayvens.be] INFO: Extracting data for car ID: 1977642
2026-03-24 22:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642
2026-03-24 22:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6eb3d18-d773-5789-bae6-90b5a76843b4 with scrape type 2
2026-03-24 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6eb3d18-d773-5789-bae6-90b5a76843b4 with scrape type 2
2026-03-24 22:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e6eb3d18-d773-5789-bae6-90b5a76843b4, identifier: 1977642
2026-03-24 22:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642
2026-03-24 22:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642
2026-03-24 22:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642 to the API
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e6eb3d18-d773-5789-bae6-90b5a76843b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 76532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977642%27 HTTP/1.1" 200 None
2026-03-24 22:49:05 [ayvens.be] INFO: Saving data for 1977642: {'auction_closing_time': 1774600200.0, 'created_time': 1774306128.101279, 'last_price_update_time': 1774392545.536428}
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977642') HTTP/1.1" 204 0
2026-03-24 22:49:05 [ayvens.be] INFO: Found listing with ID: 1977643
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977643%27 HTTP/1.1" 200 None
2026-03-24 22:49:05 [ayvens.be] INFO: Scrape type for 1977643: 2
2026-03-24 22:49:05 [ayvens.be] INFO: Extracting data for car ID: 1977643
2026-03-24 22:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643
2026-03-24 22:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with scrape type 2
2026-03-24 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with scrape type 2
2026-03-24 22:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6, identifier: 1977643
2026-03-24 22:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643
2026-03-24 22:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643
2026-03-24 22:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643 to the API
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '0fd093f2-9a35-53a6-be04-9222e5ec0ff6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 64402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977643%27 HTTP/1.1" 200 None
2026-03-24 22:49:05 [ayvens.be] INFO: Saving data for 1977643: {'auction_closing_time': 1774600200.0, 'created_time': 1774306129.637529, 'last_price_update_time': 1774392545.973412}
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977643') HTTP/1.1" 204 0
2026-03-24 22:49:06 [ayvens.be] INFO: Found listing with ID: 1977644
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977644%27 HTTP/1.1" 200 None
2026-03-24 22:49:06 [ayvens.be] INFO: Scrape type for 1977644: 2
2026-03-24 22:49:06 [ayvens.be] INFO: Extracting data for car ID: 1977644
2026-03-24 22:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644
2026-03-24 22:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with scrape type 2
2026-03-24 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with scrape type 2
2026-03-24 22:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd, identifier: 1977644
2026-03-24 22:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644
2026-03-24 22:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644
2026-03-24 22:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644 to the API
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '914b0f3b-2e2f-5dad-bb98-58fa8eea90bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 62021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI MHEV 81KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.0 TSI MHEV 81KW DSG CLEVER+',
 'vin': None,
 'year': 2023}
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977644%27 HTTP/1.1" 200 None
2026-03-24 22:49:06 [ayvens.be] INFO: Saving data for 1977644: {'auction_closing_time': 1774600200.0, 'created_time': 1774306131.140362, 'last_price_update_time': 1774392546.423026}
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977644') HTTP/1.1" 204 0
2026-03-24 22:49:06 [ayvens.be] INFO: Found listing with ID: 1977645
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977645%27 HTTP/1.1" 200 None
2026-03-24 22:49:06 [ayvens.be] INFO: Scrape type for 1977645: 2
2026-03-24 22:49:06 [ayvens.be] INFO: Extracting data for car ID: 1977645
2026-03-24 22:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645
2026-03-24 22:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 814d2c36-6229-5ab3-b05a-23a12b4c94ff with scrape type 2
2026-03-24 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 814d2c36-6229-5ab3-b05a-23a12b4c94ff with scrape type 2
2026-03-24 22:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 814d2c36-6229-5ab3-b05a-23a12b4c94ff, identifier: 1977645
2026-03-24 22:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645
2026-03-24 22:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645
2026-03-24 22:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645 to the API
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '814d2c36-6229-5ab3-b05a-23a12b4c94ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 89692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977645%27 HTTP/1.1" 200 None
2026-03-24 22:49:06 [ayvens.be] INFO: Saving data for 1977645: {'auction_closing_time': 1774600200.0, 'created_time': 1774306132.78185, 'last_price_update_time': 1774392546.796692}
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977645') HTTP/1.1" 204 0
2026-03-24 22:49:06 [ayvens.be] INFO: Found listing with ID: 1977646
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977646%27 HTTP/1.1" 200 None
2026-03-24 22:49:06 [ayvens.be] INFO: Scrape type for 1977646: 2
2026-03-24 22:49:06 [ayvens.be] INFO: Extracting data for car ID: 1977646
2026-03-24 22:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646
2026-03-24 22:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1569a679-9137-588f-9b01-c3bb9afa5b34 with scrape type 2
2026-03-24 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1569a679-9137-588f-9b01-c3bb9afa5b34 with scrape type 2
2026-03-24 22:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1569a679-9137-588f-9b01-c3bb9afa5b34, identifier: 1977646
2026-03-24 22:49:06 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at -1 pages/min), scraped 216 items (at 124 items/min)
2026-03-24 22:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-24 22:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646
2026-03-24 22:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646
2026-03-24 22:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646 to the API
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '1569a679-9137-588f-9b01-c3bb9afa5b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 58869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977646%27 HTTP/1.1" 200 None
2026-03-24 22:49:07 [ayvens.be] INFO: Saving data for 1977646: {'auction_closing_time': 1774600200.0, 'created_time': 1774306134.614206, 'last_price_update_time': 1774392547.171954}
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977646') HTTP/1.1" 204 0
2026-03-24 22:49:07 [ayvens.be] INFO: Found listing with ID: 1977647
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977647%27 HTTP/1.1" 200 None
2026-03-24 22:49:07 [ayvens.be] INFO: Scrape type for 1977647: 2
2026-03-24 22:49:07 [ayvens.be] INFO: Extracting data for car ID: 1977647
2026-03-24 22:49:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647
2026-03-24 22:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with scrape type 2
2026-03-24 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with scrape type 2
2026-03-24 22:49:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6205baa6-9762-57bd-b12c-8ce1b3efbec2, identifier: 1977647
2026-03-24 22:49:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647
2026-03-24 22:49:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647
2026-03-24 22:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647 to the API
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '6205baa6-9762-57bd-b12c-8ce1b3efbec2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER 50A FOURGON LWB HR DSL',
 'odometer': 137528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 50A FOURGON LWB HR DSL 2.0 TDI',
 'transmission': 'automatic',
 'trim': '2.0 TDI',
 'vin': None,
 'year': 2020}
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977647%27 HTTP/1.1" 200 None
2026-03-24 22:49:07 [ayvens.be] INFO: Saving data for 1977647: {'auction_closing_time': 1774600200.0, 'created_time': 1774306136.152125, 'last_price_update_time': 1774392547.553849}
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977647') HTTP/1.1" 204 0
2026-03-24 22:49:07 [ayvens.be] INFO: Found listing with ID: 1977648
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977648%27 HTTP/1.1" 200 None
2026-03-24 22:49:07 [ayvens.be] INFO: Scrape type for 1977648: 2
2026-03-24 22:49:07 [ayvens.be] INFO: Extracting data for car ID: 1977648
2026-03-24 22:49:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648
2026-03-24 22:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2401b826-b801-509d-8e4b-bbef750b2607 with scrape type 2
2026-03-24 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2401b826-b801-509d-8e4b-bbef750b2607 with scrape type 2
2026-03-24 22:49:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2401b826-b801-509d-8e4b-bbef750b2607, identifier: 1977648
2026-03-24 22:49:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648
2026-03-24 22:49:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648
2026-03-24 22:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648 to the API
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '2401b826-b801-509d-8e4b-bbef750b2607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER 35 FOURGON MWB HR DSL',
 'odometer': 238611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 FOURGON MWB HR DSL 2.0 CR TDi L3H3 4Motion '
          'Automatic-8',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi L3H3 4Motion Automatic-8',
 'vin': None,
 'year': 2020}
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977648%27 HTTP/1.1" 200 None
2026-03-24 22:49:07 [ayvens.be] INFO: Saving data for 1977648: {'auction_closing_time': 1774600200.0, 'created_time': 1774306137.615192, 'last_price_update_time': 1774392547.931151}
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977648') HTTP/1.1" 204 0
2026-03-24 22:49:07 [ayvens.be] INFO: Found listing with ID: 1977649
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977649%27 HTTP/1.1" 200 None
2026-03-24 22:49:07 [ayvens.be] INFO: Scrape type for 1977649: 2
2026-03-24 22:49:07 [ayvens.be] INFO: Extracting data for car ID: 1977649
2026-03-24 22:49:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649
2026-03-24 22:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with scrape type 2
2026-03-24 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with scrape type 2
2026-03-24 22:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37, identifier: 1977649
2026-03-24 22:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649
2026-03-24 22:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649
2026-03-24 22:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649 to the API
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 170952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 2.0 CLA 200 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 CLA 200 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977649%27 HTTP/1.1" 200 None
2026-03-24 22:49:08 [ayvens.be] INFO: Saving data for 1977649: {'auction_closing_time': 1774600200.0, 'created_time': 1774306140.052591, 'last_price_update_time': 1774392548.301806}
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977649') HTTP/1.1" 204 0
2026-03-24 22:49:08 [ayvens.be] INFO: Found listing with ID: 1977650
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977650%27 HTTP/1.1" 200 None
2026-03-24 22:49:08 [ayvens.be] INFO: Scrape type for 1977650: 2
2026-03-24 22:49:08 [ayvens.be] INFO: Extracting data for car ID: 1977650
2026-03-24 22:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650
2026-03-24 22:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with scrape type 2
2026-03-24 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with scrape type 2
2026-03-24 22:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519, identifier: 1977650
2026-03-24 22:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650
2026-03-24 22:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650
2026-03-24 22:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650 to the API
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 84901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 180 AMG LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 180 AMG LINE DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977650%27 HTTP/1.1" 200 None
2026-03-24 22:49:08 [ayvens.be] INFO: Saving data for 1977650: {'auction_closing_time': 1774600200.0, 'created_time': 1774306142.548573, 'last_price_update_time': 1774392548.685444}
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977650') HTTP/1.1" 204 0
2026-03-24 22:49:08 [ayvens.be] INFO: Found listing with ID: 1977651
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977651%27 HTTP/1.1" 200 None
2026-03-24 22:49:08 [ayvens.be] INFO: Scrape type for 1977651: 2
2026-03-24 22:49:08 [ayvens.be] INFO: Extracting data for car ID: 1977651
2026-03-24 22:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651
2026-03-24 22:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4371569f-bc3c-5de1-936c-0c8550d1ac98 with scrape type 2
2026-03-24 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4371569f-bc3c-5de1-936c-0c8550d1ac98 with scrape type 2
2026-03-24 22:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4371569f-bc3c-5de1-936c-0c8550d1ac98, identifier: 1977651
2026-03-24 22:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651
2026-03-24 22:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651
2026-03-24 22:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651 to the API
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4371569f-bc3c-5de1-936c-0c8550d1ac98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 92220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.5 BLUEHDI 96KW S-S AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 96KW S-S AUTO ACTIVE PACK',
 'vin': None,
 'year': 2023}
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977651%27 HTTP/1.1" 200 None
2026-03-24 22:49:09 [ayvens.be] INFO: Saving data for 1977651: {'auction_closing_time': 1774600200.0, 'created_time': 1774306143.447302, 'last_price_update_time': 1774392549.066707}
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977651') HTTP/1.1" 204 0
2026-03-24 22:49:09 [ayvens.be] INFO: Found listing with ID: 1977652
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977652%27 HTTP/1.1" 200 None
2026-03-24 22:49:09 [ayvens.be] INFO: Scrape type for 1977652: 2
2026-03-24 22:49:09 [ayvens.be] INFO: Extracting data for car ID: 1977652
2026-03-24 22:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652
2026-03-24 22:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eb65bea-c7a6-59ea-821b-c1f675131729 with scrape type 2
2026-03-24 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5eb65bea-c7a6-59ea-821b-c1f675131729 with scrape type 2
2026-03-24 22:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5eb65bea-c7a6-59ea-821b-c1f675131729, identifier: 1977652
2026-03-24 22:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652
2026-03-24 22:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652
2026-03-24 22:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652 to the API
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5eb65bea-c7a6-59ea-821b-c1f675131729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 83843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.5  A 180 D BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.5  A 180 D BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977652%27 HTTP/1.1" 200 None
2026-03-24 22:49:09 [ayvens.be] INFO: Saving data for 1977652: {'auction_closing_time': 1774600200.0, 'created_time': 1774306145.64127, 'last_price_update_time': 1774392549.436447}
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977652') HTTP/1.1" 204 0
2026-03-24 22:49:09 [ayvens.be] INFO: Found listing with ID: 1977653
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977653%27 HTTP/1.1" 200 None
2026-03-24 22:49:09 [ayvens.be] INFO: Scrape type for 1977653: 2
2026-03-24 22:49:09 [ayvens.be] INFO: Extracting data for car ID: 1977653
2026-03-24 22:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653
2026-03-24 22:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with scrape type 2
2026-03-24 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with scrape type 2
2026-03-24 22:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71f81a0e-a421-5d81-a66c-c31ca3add5c4, identifier: 1977653
2026-03-24 22:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653
2026-03-24 22:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653
2026-03-24 22:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653 to the API
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '71f81a0e-a421-5d81-a66c-c31ca3add5c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 97378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 INSCRIPTION AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 INSCRIPTION AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977653%27 HTTP/1.1" 200 None
2026-03-24 22:49:09 [ayvens.be] INFO: Saving data for 1977653: {'auction_closing_time': 1774600200.0, 'created_time': 1774306146.908984, 'last_price_update_time': 1774392549.842325}
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977653') HTTP/1.1" 204 0
2026-03-24 22:49:09 [ayvens.be] INFO: Found listing with ID: 1977654
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977654%27 HTTP/1.1" 200 None
2026-03-24 22:49:09 [ayvens.be] INFO: Scrape type for 1977654: 2
2026-03-24 22:49:09 [ayvens.be] INFO: Extracting data for car ID: 1977654
2026-03-24 22:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654
2026-03-24 22:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d73573a-a368-5a86-899a-67b284d5eac9 with scrape type 2
2026-03-24 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d73573a-a368-5a86-899a-67b284d5eac9 with scrape type 2
2026-03-24 22:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3d73573a-a368-5a86-899a-67b284d5eac9, identifier: 1977654
2026-03-24 22:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654
2026-03-24 22:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654
2026-03-24 22:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654 to the API
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3d73573a-a368-5a86-899a-67b284d5eac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 53660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 160 Business Solution',
 'transmission': 'manual',
 'trim': 'A 160 Business Solution',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977654%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Saving data for 1977654: {'auction_closing_time': 1774600200.0, 'created_time': 1774306148.67269, 'last_price_update_time': 1774392550.219737}
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977654') HTTP/1.1" 204 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977655
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977655%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977655: 2
2026-03-24 22:49:10 [ayvens.be] INFO: Extracting data for car ID: 1977655
2026-03-24 22:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655
2026-03-24 22:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda391cb-dd87-5c47-bb85-a53130a04133 with scrape type 2
2026-03-24 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fda391cb-dd87-5c47-bb85-a53130a04133 with scrape type 2
2026-03-24 22:49:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fda391cb-dd87-5c47-bb85-a53130a04133, identifier: 1977655
2026-03-24 22:49:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655
2026-03-24 22:49:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655
2026-03-24 22:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655 to the API
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fda391cb-dd87-5c47-bb85-a53130a04133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 104044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18IA (100KW)',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE18IA (100KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977655%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Saving data for 1977655: {'auction_closing_time': 1774600200.0, 'created_time': 1774306150.08875, 'last_price_update_time': 1774392550.712647}
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977655') HTTP/1.1" 204 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977656
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977656%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977656: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977657
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977657%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977657: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977658
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977658%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977658: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977659
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977659%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977659: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977660
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977660%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977660: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977661
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977661%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977661: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977662
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977662%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977662: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977663
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977663%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977663: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977664
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977664%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977664: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977665
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977665%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977665: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977666
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977666%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977666: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977667
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977667%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977667: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977668
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977668%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977668: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977669
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977669%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977669: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977670
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977670%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977670: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977671
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977671%27 HTTP/1.1" 200 None
2026-03-24 22:49:10 [ayvens.be] INFO: Scrape type for 1977671: 0
2026-03-24 22:49:10 [ayvens.be] INFO: Found listing with ID: 1977672
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977672%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977672: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977673
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977673%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977673: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977674
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977674%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977674: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977675
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977675%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977675: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977676
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977676%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977676: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977677
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977677%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977677: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977678
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977678%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977678: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977679
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977679%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977679: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977680
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977680%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977680: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977681
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977681%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977681: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977682
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977682%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977682: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977683
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977683%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977683: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977684
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977684%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977684: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977685
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977685%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977685: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977686
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977686%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977686: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977687
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977687%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977687: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977688
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977688%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977688: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977689
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977689%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977689: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977690
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977690%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977690: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977691
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977691%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977691: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977692
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977692%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977692: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977693
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977693%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977693: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977694
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977694%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977694: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977695
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977695%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977695: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977696
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977696%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977696: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977697
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977697%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977697: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Found listing with ID: 1977698
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977698%27 HTTP/1.1" 200 None
2026-03-24 22:49:11 [ayvens.be] INFO: Scrape type for 1977698: 0
2026-03-24 22:49:11 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-24 22:49:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977699
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977699%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977699: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977700
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977700%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977700: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977701
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977701%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977701: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977702
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977702%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977702: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977703
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977703%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977703: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977704
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977704%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977704: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977705
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977705%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977705: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977706
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977706%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977706: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977707
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977707%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977707: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977708
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977708%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977708: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977709
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977709%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977709: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977710
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977710%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977710: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977711
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977711%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977711: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977712
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977712%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977712: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1977713
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977713%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1977713: 0
2026-03-24 22:49:13 [ayvens.be] INFO: Found listing with ID: 1980237
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980237%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [ayvens.be] INFO: Scrape type for 1980237: 1
2026-03-24 22:49:13 [ayvens.be] INFO: Extracting data for car ID: 1980237
2026-03-24 22:49:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1980237
2026-03-24 22:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with scrape type 1
2026-03-24 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/1.jpg not downloaded yet
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/2.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/3.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/4.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/5.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/6.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/7.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/8.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/9.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/10.jpg not downloaded yet
2026-03-24 22:49:14 [ayvens.be] INFO: Found listing with ID: 1980238
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980238%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [ayvens.be] INFO: Scrape type for 1980238: 1
2026-03-24 22:49:14 [ayvens.be] INFO: Extracting data for car ID: 1980238
2026-03-24 22:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1980238
2026-03-24 22:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99a21a0-6528-59bd-b83a-0a37275320b1 with scrape type 1
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/1.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/2.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/3.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/4.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/5.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/6.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/7.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/8.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/9.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/10.jpg not downloaded yet
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [ayvens.be] INFO: Found listing with ID: 1980239
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980239%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [ayvens.be] INFO: Scrape type for 1980239: 1
2026-03-24 22:49:14 [ayvens.be] INFO: Extracting data for car ID: 1980239
2026-03-24 22:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d664978-b2a9-5e27-8f5d-816862f2cc57 with identifier: 1980239
2026-03-24 22:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d664978-b2a9-5e27-8f5d-816862f2cc57 with scrape type 1
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/1.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/2.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/3.jpg not downloaded yet
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/4.jpg not downloaded yet
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/5.jpg not downloaded yet
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/6.jpg not downloaded yet
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009466c10>
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/1.jpg saved to cache
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/7.jpg not downloaded yet
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/8.jpg not downloaded yet
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/9.jpg not downloaded yet
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916ed50>
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/3.jpg saved to cache
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098619d0>
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/5.jpg saved to cache
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009617ed0>
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/7.jpg saved to cache
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfff90>
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/2.jpg saved to cache
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/10.jpg not downloaded yet
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:14 [ayvens.be] INFO: Found listing with ID: 1980240
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980240%27 HTTP/1.1" 200 None
2026-03-24 22:49:15 [ayvens.be] INFO: Scrape type for 1980240: 1
2026-03-24 22:49:15 [ayvens.be] INFO: Extracting data for car ID: 1980240
2026-03-24 22:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f9f152f-4974-5408-8a46-f15aa26e16f8 with identifier: 1980240
2026-03-24 22:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f9f152f-4974-5408-8a46-f15aa26e16f8 with scrape type 1
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/1.jpg not downloaded yet
2026-03-24 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00919a510>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/9.jpg saved to cache
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110fd0>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/4.jpg saved to cache
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492c50>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/8.jpg saved to cache
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112c10>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/1.jpg saved to cache
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449cd0>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/2.jpg saved to cache
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/2.jpg not downloaded yet
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/3.jpg not downloaded yet
2026-03-24 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/4.jpg not downloaded yet
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009184e50>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/4.jpg saved to cache
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009147450>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/3.jpg saved to cache
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00986bb10>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/6.jpg saved to cache
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/5.jpg not downloaded yet
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/6.jpg not downloaded yet
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c890>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F834e1c07a99e48059de4b244a2ce09c7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/10.jpg saved to cache
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9
2026-03-24 22:49:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9, skipping ID generation
2026-03-24 22:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with scrape type 1
2026-03-24 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 sending to next pipeline
2026-03-24 22:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9, identifier: 1980237
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6dd0>
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/2.jpg saved to cache
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bfa10>
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/6.jpg saved to cache
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28790>
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/5.jpg saved to cache
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/7.jpg not downloaded yet
2026-03-24 22:49:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1980237
2026-03-24 22:49:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:49:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1980237
2026-03-24 22:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1980237 to the API
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 47,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cedfca8f-75b5-5fc8-8992-8c4e6b512ab9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 138035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cedfca8f-75b5-5fc8-8992-8c4e6b512ab9/cedfca8f-75b5-5fc8-8992-8c4e6b512ab9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/834e1c07a99e48059de4b244a2ce09c7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV Recharge Pro DCT',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV Recharge Pro DCT',
 'vin': None,
 'year': 2020}
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980237%27 HTTP/1.1" 200 None
2026-03-24 22:49:16 [ayvens.be] INFO: Saving data for 1980237: {'created_time': 1774392556.54588, 'last_price_update_time': 1774392556.545889, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980237') HTTP/1.1" 204 0
2026-03-24 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/8.jpg not downloaded yet
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/9.jpg not downloaded yet
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464f10>
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/10.jpg saved to cache
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6990>
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/4.jpg saved to cache
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912be10>
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/3.jpg saved to cache
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/10.jpg not downloaded yet
2026-03-24 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:16 [ayvens.be] INFO: Found listing with ID: 1980241
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980241%27 HTTP/1.1" 200 None
2026-03-24 22:49:16 [ayvens.be] INFO: Scrape type for 1980241: 1
2026-03-24 22:49:16 [ayvens.be] INFO: Extracting data for car ID: 1980241
2026-03-24 22:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1980241
2026-03-24 22:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with scrape type 1
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/1.jpg not downloaded yet
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ba5d0>
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/5.jpg saved to cache
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bcd50>
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/6.jpg saved to cache
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/2.jpg not downloaded yet
2026-03-24 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/3.jpg not downloaded yet
2026-03-24 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/4.jpg not downloaded yet
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009465e10>
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/1.jpg saved to cache
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441cd0>
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/8.jpg saved to cache
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009687a10>
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/7.jpg saved to cache
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008c93d10>
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/9.jpg saved to cache
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083099d0>
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/9.jpg saved to cache
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/5.jpg not downloaded yet
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/6.jpg not downloaded yet
2026-03-24 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838d210>
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/8.jpg saved to cache
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9050>
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3250ceca2e6f4fc0be6b25e9aa3ae833%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/10.jpg saved to cache
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d664978-b2a9-5e27-8f5d-816862f2cc57
2026-03-24 22:49:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d664978-b2a9-5e27-8f5d-816862f2cc57, skipping ID generation
2026-03-24 22:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d664978-b2a9-5e27-8f5d-816862f2cc57 with scrape type 1
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d664978-b2a9-5e27-8f5d-816862f2cc57 sending to next pipeline
2026-03-24 22:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8d664978-b2a9-5e27-8f5d-816862f2cc57, identifier: 1980239
2026-03-24 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/7.jpg not downloaded yet
2026-03-24 22:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8d664978-b2a9-5e27-8f5d-816862f2cc57 with identifier: 1980239
2026-03-24 22:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8d664978-b2a9-5e27-8f5d-816862f2cc57 with identifier: 1980239
2026-03-24 22:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8d664978-b2a9-5e27-8f5d-816862f2cc57 with identifier: 1980239 to the API
2026-03-24 22:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d664978-b2a9-5e27-8f5d-816862f2cc57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE GLE DIESEL (W167)',
 'odometer': 148382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d664978-b2a9-5e27-8f5d-816862f2cc57/8d664978-b2a9-5e27-8f5d-816862f2cc57_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3250ceca2e6f4fc0be6b25e9aa3ae833/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE GLE DIESEL (W167) GLE 350 de 4-Matic PHEV',
 'transmission': 'automatic',
 'trim': 'GLE 350 de 4-Matic PHEV',
 'vin': None,
 'year': 2020}
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980239%27 HTTP/1.1" 200 None
2026-03-24 22:49:18 [ayvens.be] INFO: Saving data for 1980239: {'created_time': 1774392558.18903, 'last_price_update_time': 1774392558.18904, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980239') HTTP/1.1" 204 0
2026-03-24 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/8.jpg not downloaded yet
2026-03-24 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/9.jpg not downloaded yet
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912abd0>
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/1.jpg saved to cache
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cff10>
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F913639f24a58410b9284f1ffaa459b83%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/7.jpg saved to cache
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c99a21a0-6528-59bd-b83a-0a37275320b1
2026-03-24 22:49:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c99a21a0-6528-59bd-b83a-0a37275320b1, skipping ID generation
2026-03-24 22:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99a21a0-6528-59bd-b83a-0a37275320b1 with scrape type 1
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c99a21a0-6528-59bd-b83a-0a37275320b1 sending to next pipeline
2026-03-24 22:49:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c99a21a0-6528-59bd-b83a-0a37275320b1, identifier: 1980238
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fb6d0>
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/3.jpg saved to cache
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cc2d0>
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/2.jpg saved to cache
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441190>
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/5.jpg saved to cache
2026-03-24 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1980238
2026-03-24 22:49:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:49:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1980238
2026-03-24 22:49:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1980238 to the API
2026-03-24 22:49:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'NACRE WIT PARELKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c99a21a0-6528-59bd-b83a-0a37275320b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 126107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c99a21a0-6528-59bd-b83a-0a37275320b1/c99a21a0-6528-59bd-b83a-0a37275320b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/913639f24a58410b9284f1ffaa459b83/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 ALLURE 7pl',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 130 ALLURE 7pl',
 'vin': None,
 'year': 2020}
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980238%27 HTTP/1.1" 200 None
2026-03-24 22:49:19 [ayvens.be] INFO: Saving data for 1980238: {'created_time': 1774392559.140419, 'last_price_update_time': 1774392559.140428, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980238') HTTP/1.1" 204 0
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/10.jpg not downloaded yet
2026-03-24 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:19 [ayvens.be] INFO: Found listing with ID: 1980242
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980242%27 HTTP/1.1" 200 None
2026-03-24 22:49:19 [ayvens.be] INFO: Scrape type for 1980242: 1
2026-03-24 22:49:19 [ayvens.be] INFO: Extracting data for car ID: 1980242
2026-03-24 22:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a40385-f5bc-5f14-9f50-1a72103c4e51 with identifier: 1980242
2026-03-24 22:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a40385-f5bc-5f14-9f50-1a72103c4e51 with scrape type 1
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/1.jpg not downloaded yet
2026-03-24 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e3190>
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/4.jpg saved to cache
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914cd50>
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/6.jpg saved to cache
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/2.jpg not downloaded yet
2026-03-24 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/3.jpg not downloaded yet
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091568d0>
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/9.jpg saved to cache
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b4fd0>
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/10.jpg saved to cache
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/4.jpg not downloaded yet
2026-03-24 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/5.jpg not downloaded yet
2026-03-24 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c7750>
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/7.jpg saved to cache
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083828d0>
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fae2c8b16082e4460842768d94f785482%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/8.jpg saved to cache
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f9f152f-4974-5408-8a46-f15aa26e16f8
2026-03-24 22:49:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f9f152f-4974-5408-8a46-f15aa26e16f8, skipping ID generation
2026-03-24 22:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f9f152f-4974-5408-8a46-f15aa26e16f8 with scrape type 1
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f9f152f-4974-5408-8a46-f15aa26e16f8 sending to next pipeline
2026-03-24 22:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7f9f152f-4974-5408-8a46-f15aa26e16f8, identifier: 1980240
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/6.jpg not downloaded yet
2026-03-24 22:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7f9f152f-4974-5408-8a46-f15aa26e16f8 with identifier: 1980240
2026-03-24 22:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7f9f152f-4974-5408-8a46-f15aa26e16f8 with identifier: 1980240
2026-03-24 22:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7f9f152f-4974-5408-8a46-f15aa26e16f8 with identifier: 1980240 to the API
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7f9f152f-4974-5408-8a46-f15aa26e16f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'TARRACO',
 'odometer': 121297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f9f152f-4974-5408-8a46-f15aa26e16f8/7f9f152f-4974-5408-8a46-f15aa26e16f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/ae2c8b16082e4460842768d94f785482/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT TARRACO 2.0 TDI 110KW MOVE DCT',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW MOVE DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980240%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [ayvens.be] INFO: Saving data for 1980240: {'created_time': 1774392560.265069, 'last_price_update_time': 1774392560.26508, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980240') HTTP/1.1" 204 0
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/7.jpg not downloaded yet
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/8.jpg not downloaded yet
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009155750>
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/1.jpg saved to cache
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1c10>
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/2.jpg saved to cache
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911fe10>
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/3.jpg saved to cache
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472810>
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/4.jpg saved to cache
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/9.jpg not downloaded yet
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/10.jpg not downloaded yet
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [ayvens.be] INFO: Found listing with ID: 1980243
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980243%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [ayvens.be] INFO: Scrape type for 1980243: 1
2026-03-24 22:49:20 [ayvens.be] INFO: Extracting data for car ID: 1980243
2026-03-24 22:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with identifier: 1980243
2026-03-24 22:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with scrape type 1
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/1.jpg not downloaded yet
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/2.jpg not downloaded yet
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/3.jpg not downloaded yet
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442ed0>
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/2.jpg saved to cache
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2bf50>
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/1.jpg saved to cache
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/4.jpg not downloaded yet
2026-03-24 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b5d0>
2026-03-24 22:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/6.jpg saved to cache
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910e9d0>
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/5.jpg saved to cache
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/5.jpg not downloaded yet
2026-03-24 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/6.jpg not downloaded yet
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb090>
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/7.jpg saved to cache
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008381710>
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/8.jpg saved to cache
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382ed0>
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/9.jpg saved to cache
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009010390>
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F94179b6a703341d1b731038c5f347b09%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/10.jpg saved to cache
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb
2026-03-24 22:49:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb, skipping ID generation
2026-03-24 22:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with scrape type 1
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb sending to next pipeline
2026-03-24 22:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb, identifier: 1980241
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096858d0>
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/4.jpg saved to cache
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914cd50>
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/6.jpg saved to cache
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b7ce910>
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/5.jpg saved to cache
2026-03-24 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1980241
2026-03-24 22:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1980241
2026-03-24 22:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1980241 to the API
2026-03-24 22:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '102740f9-a11d-52fd-a67d-bdfa14b5e0fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 125107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_102740f9-a11d-52fd-a67d-bdfa14b5e0fb/102740f9-a11d-52fd-a67d-bdfa14b5e0fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/94179b6a703341d1b731038c5f347b09/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 dA sDrive16 AdBlue',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980241%27 HTTP/1.1" 200 None
2026-03-24 22:49:22 [ayvens.be] INFO: Saving data for 1980241: {'created_time': 1774392562.117712, 'last_price_update_time': 1774392562.117722, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980241') HTTP/1.1" 204 0
2026-03-24 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/7.jpg not downloaded yet
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839a890>
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/3.jpg saved to cache
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0f10>
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/7.jpg saved to cache
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/8.jpg not downloaded yet
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a5a50>
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/8.jpg saved to cache
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911b9d0>
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/10.jpg saved to cache
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/9.jpg not downloaded yet
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02ad0>
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hb%252F4327784dce364502b84fbb28484ab8fc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/9.jpg saved to cache
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4a40385-f5bc-5f14-9f50-1a72103c4e51
2026-03-24 22:49:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4a40385-f5bc-5f14-9f50-1a72103c4e51, skipping ID generation
2026-03-24 22:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a40385-f5bc-5f14-9f50-1a72103c4e51 with scrape type 1
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4a40385-f5bc-5f14-9f50-1a72103c4e51 sending to next pipeline
2026-03-24 22:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a4a40385-f5bc-5f14-9f50-1a72103c4e51, identifier: 1980242
2026-03-24 22:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a4a40385-f5bc-5f14-9f50-1a72103c4e51 with identifier: 1980242
2026-03-24 22:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a4a40385-f5bc-5f14-9f50-1a72103c4e51 with identifier: 1980242
2026-03-24 22:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a4a40385-f5bc-5f14-9f50-1a72103c4e51 with identifier: 1980242 to the API
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a4a40385-f5bc-5f14-9f50-1a72103c4e51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 138765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4a40385-f5bc-5f14-9f50-1a72103c4e51/a4a40385-f5bc-5f14-9f50-1a72103c4e51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hb/4327784dce364502b84fbb28484ab8fc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2020}
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980242%27 HTTP/1.1" 200 None
2026-03-24 22:49:22 [ayvens.be] INFO: Saving data for 1980242: {'created_time': 1774392562.947547, 'last_price_update_time': 1774392562.947556, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980242') HTTP/1.1" 204 0
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/10.jpg not downloaded yet
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838cc50>
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/1.jpg saved to cache
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:23 [ayvens.be] INFO: Found listing with ID: 1980244
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980244%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [ayvens.be] INFO: Scrape type for 1980244: 1
2026-03-24 22:49:23 [ayvens.be] INFO: Extracting data for car ID: 1980244
2026-03-24 22:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1980244
2026-03-24 22:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9129de0-b3cc-56eb-8492-96e4712690fb with scrape type 1
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/1.jpg not downloaded yet
2026-03-24 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/2.jpg not downloaded yet
2026-03-24 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/3.jpg not downloaded yet
2026-03-24 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/4.jpg not downloaded yet
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/5.jpg not downloaded yet
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095edc10>
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/5.jpg saved to cache
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/6.jpg not downloaded yet
2026-03-24 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/7.jpg not downloaded yet
2026-03-24 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394710>
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/4.jpg saved to cache
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964e1d0>
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/7.jpg saved to cache
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013250>
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/3.jpg saved to cache
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2a6d0>
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/2.jpg saved to cache
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009012990>
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/6.jpg saved to cache
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d9310>
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/8.jpg saved to cache
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/8.jpg not downloaded yet
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/9.jpg not downloaded yet
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8a10>
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/9.jpg saved to cache
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b6f90>
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F537f8c92582640fd801456707248026d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/10.jpg saved to cache
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce
2026-03-24 22:49:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce, skipping ID generation
2026-03-24 22:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with scrape type 1
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce sending to next pipeline
2026-03-24 22:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce, identifier: 1980243
2026-03-24 22:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with identifier: 1980243
2026-03-24 22:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with identifier: 1980243
2026-03-24 22:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with identifier: 1980243 to the API
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '67b5b8e4-126d-509d-8cc6-62cdd828b0ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 142512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67b5b8e4-126d-509d-8cc6-62cdd828b0ce/67b5b8e4-126d-509d-8cc6-62cdd828b0ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/537f8c92582640fd801456707248026d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 30 TDI 100KW S TR BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980243%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [ayvens.be] INFO: Saving data for 1980243: {'created_time': 1774392564.552657, 'last_price_update_time': 1774392564.552666, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980243') HTTP/1.1" 204 0
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/10.jpg not downloaded yet
2026-03-24 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:24 [ayvens.be] INFO: Found listing with ID: 1980245
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980245%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [ayvens.be] INFO: Scrape type for 1980245: 1
2026-03-24 22:49:24 [ayvens.be] INFO: Extracting data for car ID: 1980245
2026-03-24 22:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1980245
2026-03-24 22:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with scrape type 1
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/1.jpg not downloaded yet
2026-03-24 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/2.jpg not downloaded yet
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/3.jpg not downloaded yet
2026-03-24 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/4.jpg not downloaded yet
2026-03-24 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/5.jpg not downloaded yet
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009617b50>
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/1.jpg saved to cache
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/6.jpg not downloaded yet
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/7.jpg not downloaded yet
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094714d0>
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/2.jpg saved to cache
2026-03-24 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b2b10>
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/3.jpg saved to cache
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838c990>
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/5.jpg saved to cache
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095efe90>
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/4.jpg saved to cache
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/8.jpg not downloaded yet
2026-03-24 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4350>
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/7.jpg saved to cache
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112b10>
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/6.jpg saved to cache
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/9.jpg not downloaded yet
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/10.jpg not downloaded yet
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb0ed0>
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/8.jpg saved to cache
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:25 [ayvens.be] INFO: Found listing with ID: 1980246
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980246%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [ayvens.be] INFO: Scrape type for 1980246: 1
2026-03-24 22:49:25 [ayvens.be] INFO: Extracting data for car ID: 1980246
2026-03-24 22:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1980246
2026-03-24 22:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e732670e-563c-5163-874a-0d3d7a0beee3 with scrape type 1
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/1.jpg not downloaded yet
2026-03-24 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/2.jpg not downloaded yet
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/3.jpg not downloaded yet
2026-03-24 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/4.jpg not downloaded yet
2026-03-24 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/5.jpg not downloaded yet
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/6.jpg not downloaded yet
2026-03-24 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c1bd0>
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/9.jpg saved to cache
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/7.jpg not downloaded yet
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/8.jpg not downloaded yet
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/9.jpg not downloaded yet
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a09d0>
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/1.jpg saved to cache
2026-03-24 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b5650>
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F3df3939d7b85455ab9e37fdc31a36008%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/10.jpg saved to cache
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9129de0-b3cc-56eb-8492-96e4712690fb
2026-03-24 22:49:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9129de0-b3cc-56eb-8492-96e4712690fb, skipping ID generation
2026-03-24 22:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9129de0-b3cc-56eb-8492-96e4712690fb with scrape type 1
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9129de0-b3cc-56eb-8492-96e4712690fb sending to next pipeline
2026-03-24 22:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d9129de0-b3cc-56eb-8492-96e4712690fb, identifier: 1980244
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916dad0>
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/2.jpg saved to cache
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009012050>
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/3.jpg saved to cache
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02090>
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/4.jpg saved to cache
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c10d0>
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/6.jpg saved to cache
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964c890>
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/5.jpg saved to cache
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1980244
2026-03-24 22:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1980244
2026-03-24 22:49:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1980244 to the API
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd9129de0-b3cc-56eb-8492-96e4712690fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE - 2019',
 'odometer': 53507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9129de0-b3cc-56eb-8492-96e4712690fb/d9129de0-b3cc-56eb-8492-96e4712690fb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/3df3939d7b85455ab9e37fdc31a36008/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE - 2019 2.0 Turbo 4WD R-Dynamic HSE',
 'transmission': 'automatic',
 'trim': '2.0 Turbo 4WD R-Dynamic HSE',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980244%27 HTTP/1.1" 200 None
2026-03-24 22:49:26 [ayvens.be] INFO: Saving data for 1980244: {'created_time': 1774392566.943399, 'last_price_update_time': 1774392566.943408, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980244') HTTP/1.1" 204 0
2026-03-24 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/10.jpg not downloaded yet
2026-03-24 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:26 [ayvens.be] INFO: Found listing with ID: 1980247
2026-03-24 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980247%27 HTTP/1.1" 200 None
2026-03-24 22:49:27 [ayvens.be] INFO: Scrape type for 1980247: 1
2026-03-24 22:49:27 [ayvens.be] INFO: Extracting data for car ID: 1980247
2026-03-24 22:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1980247
2026-03-24 22:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e48b0d-73c6-561d-946b-a94fc8b7222f with scrape type 1
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/1.jpg not downloaded yet
2026-03-24 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/2.jpg not downloaded yet
2026-03-24 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/3.jpg not downloaded yet
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/4.jpg not downloaded yet
2026-03-24 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/5.jpg not downloaded yet
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359290>
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/7.jpg saved to cache
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/6.jpg not downloaded yet
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a8050>
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/1.jpg saved to cache
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/7.jpg not downloaded yet
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/8.jpg not downloaded yet
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeafc50>
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/10.jpg saved to cache
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406850>
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/3.jpg saved to cache
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cc5d0>
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/8.jpg saved to cache
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed2310>
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/2.jpg saved to cache
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d5e50>
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ff49af8f6bb5b45cab4d90130ee99ce61%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/9.jpg saved to cache
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0
2026-03-24 22:49:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2e04f41-d376-5af6-88b1-4d1b9319a3f0, skipping ID generation
2026-03-24 22:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with scrape type 1
2026-03-24 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 sending to next pipeline
2026-03-24 22:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2e04f41-d376-5af6-88b1-4d1b9319a3f0, identifier: 1980245
2026-03-24 22:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1980245
2026-03-24 22:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1980245
2026-03-24 22:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1980245 to the API
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a2e04f41-d376-5af6-88b1-4d1b9319a3f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 78299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 892821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 864674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e04f41-d376-5af6-88b1-4d1b9319a3f0/a2e04f41-d376-5af6-88b1-4d1b9319a3f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 855760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/f49af8f6bb5b45cab4d90130ee99ce61/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980245%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [ayvens.be] INFO: Saving data for 1980245: {'created_time': 1774392568.330206, 'last_price_update_time': 1774392568.330217, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980245') HTTP/1.1" 204 0
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/9.jpg not downloaded yet
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/10.jpg not downloaded yet
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [ayvens.be] INFO: Found listing with ID: 1980248
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980248%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [ayvens.be] INFO: Scrape type for 1980248: 1
2026-03-24 22:49:28 [ayvens.be] INFO: Extracting data for car ID: 1980248
2026-03-24 22:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1980248
2026-03-24 22:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with scrape type 1
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/1.jpg not downloaded yet
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/2.jpg not downloaded yet
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/3.jpg not downloaded yet
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009616a50>
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/1.jpg saved to cache
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/4.jpg not downloaded yet
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b5710>
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/5.jpg saved to cache
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/5.jpg not downloaded yet
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/6.jpg not downloaded yet
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b2966d0>
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/7.jpg saved to cache
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2510>
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/4.jpg saved to cache
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008316650>
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/6.jpg saved to cache
2026-03-24 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083161d0>
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/10.jpg saved to cache
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d6e90>
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/8.jpg saved to cache
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3fd0>
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/6.jpg saved to cache
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/7.jpg not downloaded yet
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed2290>
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F7e4d900fd11044ca92a73f4e11afd965%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/9.jpg saved to cache
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e732670e-563c-5163-874a-0d3d7a0beee3
2026-03-24 22:49:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e732670e-563c-5163-874a-0d3d7a0beee3, skipping ID generation
2026-03-24 22:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e732670e-563c-5163-874a-0d3d7a0beee3 with scrape type 1
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e732670e-563c-5163-874a-0d3d7a0beee3 sending to next pipeline
2026-03-24 22:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e732670e-563c-5163-874a-0d3d7a0beee3, identifier: 1980246
2026-03-24 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1980246
2026-03-24 22:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1980246
2026-03-24 22:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1980246 to the API
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'e732670e-563c-5163-874a-0d3d7a0beee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQB',
 'odometer': 71471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 904371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e732670e-563c-5163-874a-0d3d7a0beee3/e732670e-563c-5163-874a-0d3d7a0beee3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/7e4d900fd11044ca92a73f4e11afd965/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQB BEV 67KWH EQB 250 BUSINESS LINE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQB 250 BUSINESS LINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980246%27 HTTP/1.1" 200 None
2026-03-24 22:49:29 [ayvens.be] INFO: Saving data for 1980246: {'created_time': 1774392569.724528, 'last_price_update_time': 1774392569.724537, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980246') HTTP/1.1" 204 0
2026-03-24 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/8.jpg not downloaded yet
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009133010>
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/5.jpg saved to cache
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359910>
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/4.jpg saved to cache
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8550>
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/2.jpg saved to cache
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/9.jpg not downloaded yet
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345190>
2026-03-24 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/7.jpg saved to cache
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0050>
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/3.jpg saved to cache
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009793550>
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/9.jpg saved to cache
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917e890>
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/8.jpg saved to cache
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/10.jpg not downloaded yet
2026-03-24 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:30 [ayvens.be] INFO: Found listing with ID: 1980249
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980249%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [ayvens.be] INFO: Scrape type for 1980249: 1
2026-03-24 22:49:30 [ayvens.be] INFO: Extracting data for car ID: 1980249
2026-03-24 22:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1980249
2026-03-24 22:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 204b260e-559e-573a-a182-0234b1a52c5d with scrape type 1
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/1.jpg not downloaded yet
2026-03-24 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/2.jpg not downloaded yet
2026-03-24 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/3.jpg not downloaded yet
2026-03-24 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/4.jpg not downloaded yet
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/5.jpg not downloaded yet
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/6.jpg not downloaded yet
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeaf610>
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3364cc46ef6e454b84017fb30737865c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/10.jpg saved to cache
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70e48b0d-73c6-561d-946b-a94fc8b7222f
2026-03-24 22:49:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70e48b0d-73c6-561d-946b-a94fc8b7222f, skipping ID generation
2026-03-24 22:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e48b0d-73c6-561d-946b-a94fc8b7222f with scrape type 1
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70e48b0d-73c6-561d-946b-a94fc8b7222f sending to next pipeline
2026-03-24 22:49:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70e48b0d-73c6-561d-946b-a94fc8b7222f, identifier: 1980247
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/7.jpg not downloaded yet
2026-03-24 22:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1980247
2026-03-24 22:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1980247
2026-03-24 22:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1980247 to the API
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '70e48b0d-73c6-561d-946b-a94fc8b7222f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 49781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e48b0d-73c6-561d-946b-a94fc8b7222f/70e48b0d-73c6-561d-946b-a94fc8b7222f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3364cc46ef6e454b84017fb30737865c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 CLA 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980247%27 HTTP/1.1" 200 None
2026-03-24 22:49:30 [ayvens.be] INFO: Saving data for 1980247: {'created_time': 1774392570.953496, 'last_price_update_time': 1774392570.953505, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980247') HTTP/1.1" 204 0
2026-03-24 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/8.jpg not downloaded yet
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019010>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/1.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761550>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/5.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760690>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/6.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009789dd0>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/2.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978aa50>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/3.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009763090>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/4.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b1d50>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/7.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/9.jpg not downloaded yet
2026-03-24 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/10.jpg not downloaded yet
2026-03-24 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a1710>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/9.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:31 [ayvens.be] INFO: Found listing with ID: 1980250
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980250%27 HTTP/1.1" 200 None
2026-03-24 22:49:31 [ayvens.be] INFO: Scrape type for 1980250: 1
2026-03-24 22:49:31 [ayvens.be] INFO: Extracting data for car ID: 1980250
2026-03-24 22:49:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1980250
2026-03-24 22:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 with scrape type 1
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/1.jpg not downloaded yet
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/2.jpg not downloaded yet
2026-03-24 22:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/3.jpg not downloaded yet
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915cd50>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/10.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009396f90>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/1.jpg saved to cache
2026-03-24 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fbf90>
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4ec13a6809744c27a86a4663871f4e1e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/8.jpg saved to cache
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877
2026-03-24 22:49:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877, skipping ID generation
2026-03-24 22:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with scrape type 1
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 sending to next pipeline
2026-03-24 22:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877, identifier: 1980248
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/4.jpg not downloaded yet
2026-03-24 22:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1980248
2026-03-24 22:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1980248
2026-03-24 22:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1980248 to the API
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 116744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877/e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4ec13a6809744c27a86a4663871f4e1e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW TITANIUM AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980248%27 HTTP/1.1" 200 None
2026-03-24 22:49:32 [ayvens.be] INFO: Saving data for 1980248: {'created_time': 1774392572.509631, 'last_price_update_time': 1774392572.509641, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980248') HTTP/1.1" 204 0
2026-03-24 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009396510>
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/2.jpg saved to cache
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d40d0>
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/4.jpg saved to cache
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3510>
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/3.jpg saved to cache
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf64d0>
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/5.jpg saved to cache
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/5.jpg not downloaded yet
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdb9d0>
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/6.jpg saved to cache
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/6.jpg not downloaded yet
2026-03-24 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d022d0>
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/7.jpg saved to cache
2026-03-24 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/7.jpg not downloaded yet
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/8.jpg not downloaded yet
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911d850>
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/8.jpg saved to cache
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131e10>
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/10.jpg saved to cache
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/9.jpg not downloaded yet
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c7350>
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbf93ed4d4e024cdd8e9e89dd1c3e2819%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/9.jpg saved to cache
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 204b260e-559e-573a-a182-0234b1a52c5d
2026-03-24 22:49:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 204b260e-559e-573a-a182-0234b1a52c5d, skipping ID generation
2026-03-24 22:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 204b260e-559e-573a-a182-0234b1a52c5d with scrape type 1
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 204b260e-559e-573a-a182-0234b1a52c5d sending to next pipeline
2026-03-24 22:49:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 204b260e-559e-573a-a182-0234b1a52c5d, identifier: 1980249
2026-03-24 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/10.jpg not downloaded yet
2026-03-24 22:49:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1980249
2026-03-24 22:49:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1980249
2026-03-24 22:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1980249 to the API
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '204b260e-559e-573a-a182-0234b1a52c5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 46415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_204b260e-559e-573a-a182-0234b1a52c5d/204b260e-559e-573a-a182-0234b1a52c5d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bf93ed4d4e024cdd8e9e89dd1c3e2819/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980249%27 HTTP/1.1" 200 None
2026-03-24 22:49:33 [ayvens.be] INFO: Saving data for 1980249: {'created_time': 1774392573.815702, 'last_price_update_time': 1774392573.815711, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980249') HTTP/1.1" 204 0
2026-03-24 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:33 [ayvens.be] INFO: Found listing with ID: 1980251
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980251%27 HTTP/1.1" 200 None
2026-03-24 22:49:33 [ayvens.be] INFO: Scrape type for 1980251: 1
2026-03-24 22:49:33 [ayvens.be] INFO: Extracting data for car ID: 1980251
2026-03-24 22:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1980251
2026-03-24 22:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d435f3e0-529f-510b-bac6-ad11c65d9078 with scrape type 1
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/1.jpg not downloaded yet
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083424d0>
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/1.jpg saved to cache
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/2.jpg not downloaded yet
2026-03-24 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/3.jpg not downloaded yet
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c310>
2026-03-24 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/2.jpg saved to cache
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/4.jpg not downloaded yet
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/5.jpg not downloaded yet
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/6.jpg not downloaded yet
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009466d10>
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/3.jpg saved to cache
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/7.jpg not downloaded yet
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94dd0>
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/4.jpg saved to cache
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873bd0>
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/6.jpg saved to cache
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8a90>
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/5.jpg saved to cache
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed2350>
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/7.jpg saved to cache
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/8.jpg not downloaded yet
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/9.jpg not downloaded yet
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/10.jpg not downloaded yet
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [ayvens.be] INFO: Found listing with ID: 1980252
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980252%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [ayvens.be] INFO: Scrape type for 1980252: 1
2026-03-24 22:49:34 [ayvens.be] INFO: Extracting data for car ID: 1980252
2026-03-24 22:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1980252
2026-03-24 22:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with scrape type 1
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/1.jpg not downloaded yet
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/2.jpg not downloaded yet
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/3.jpg not downloaded yet
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/4.jpg not downloaded yet
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/5.jpg not downloaded yet
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0f10>
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/9.jpg saved to cache
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/6.jpg not downloaded yet
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/7.jpg not downloaded yet
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/8.jpg not downloaded yet
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a07d0>
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/1.jpg saved to cache
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091543d0>
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/2.jpg saved to cache
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096dc650>
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/3.jpg saved to cache
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900b310>
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/8.jpg saved to cache
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916e850>
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/5.jpg saved to cache
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009154d50>
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F402c324361e34fb4adb73b73cadcea07%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/10.jpg saved to cache
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cd1f4af-ca6c-5179-834b-195bc36a2958
2026-03-24 22:49:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cd1f4af-ca6c-5179-834b-195bc36a2958, skipping ID generation
2026-03-24 22:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 with scrape type 1
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 sending to next pipeline
2026-03-24 22:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cd1f4af-ca6c-5179-834b-195bc36a2958, identifier: 1980250
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed8290>
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/4.jpg saved to cache
2026-03-24 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1980250
2026-03-24 22:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1980250
2026-03-24 22:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1980250 to the API
2026-03-24 22:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '2cd1f4af-ca6c-5179-834b-195bc36a2958',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 107677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 918076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cd1f4af-ca6c-5179-834b-195bc36a2958/2cd1f4af-ca6c-5179-834b-195bc36a2958_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 896162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/402c324361e34fb4adb73b73cadcea07/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 110KW CLEVER+',
 'transmission': 'manual',
 'trim': '2.0 CRTDI 110KW CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980250%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [ayvens.be] INFO: Saving data for 1980250: {'created_time': 1774392576.189487, 'last_price_update_time': 1774392576.189498, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980250') HTTP/1.1" 204 0
2026-03-24 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/9.jpg not downloaded yet
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/10.jpg not downloaded yet
2026-03-24 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:36 [ayvens.be] INFO: Found listing with ID: 1980253
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980253%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [ayvens.be] INFO: Scrape type for 1980253: 1
2026-03-24 22:49:36 [ayvens.be] INFO: Extracting data for car ID: 1980253
2026-03-24 22:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with identifier: 1980253
2026-03-24 22:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with scrape type 1
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/1.jpg not downloaded yet
2026-03-24 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/2.jpg not downloaded yet
2026-03-24 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/3.jpg not downloaded yet
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b8650>
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/6.jpg saved to cache
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/4.jpg not downloaded yet
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/5.jpg not downloaded yet
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/6.jpg not downloaded yet
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d00410>
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/1.jpg saved to cache
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967f890>
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/7.jpg saved to cache
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00833a010>
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/10.jpg saved to cache
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a4e50>
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/9.jpg saved to cache
2026-03-24 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed8290>
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F7c19944806cf458e98ab5917cf2b7ef8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/8.jpg saved to cache
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d435f3e0-529f-510b-bac6-ad11c65d9078
2026-03-24 22:49:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d435f3e0-529f-510b-bac6-ad11c65d9078, skipping ID generation
2026-03-24 22:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d435f3e0-529f-510b-bac6-ad11c65d9078 with scrape type 1
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d435f3e0-529f-510b-bac6-ad11c65d9078 sending to next pipeline
2026-03-24 22:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d435f3e0-529f-510b-bac6-ad11c65d9078, identifier: 1980251
2026-03-24 22:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1980251
2026-03-24 22:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1980251
2026-03-24 22:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1980251 to the API
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'd435f3e0-529f-510b-bac6-ad11c65d9078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 188744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435f3e0-529f-510b-bac6-ad11c65d9078/d435f3e0-529f-510b-bac6-ad11c65d9078_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/7c19944806cf458e98ab5917cf2b7ef8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 78KWH RECHARGE TWIN PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH RECHARGE TWIN PLUS',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980251%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [ayvens.be] INFO: Saving data for 1980251: {'created_time': 1774392577.642219, 'last_price_update_time': 1774392577.642229, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980251') HTTP/1.1" 204 0
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/7.jpg not downloaded yet
2026-03-24 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/8.jpg not downloaded yet
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/9.jpg not downloaded yet
2026-03-24 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/10.jpg not downloaded yet
2026-03-24 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:37 [ayvens.be] INFO: Found listing with ID: 1980254
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980254%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [ayvens.be] INFO: Scrape type for 1980254: 1
2026-03-24 22:49:37 [ayvens.be] INFO: Extracting data for car ID: 1980254
2026-03-24 22:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1980254
2026-03-24 22:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773e2031-4730-5eec-ada3-05f112376a35 with scrape type 1
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/1.jpg not downloaded yet
2026-03-24 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/2.jpg not downloaded yet
2026-03-24 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/3.jpg not downloaded yet
2026-03-24 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009617390>
2026-03-24 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/7.jpg saved to cache
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/4.jpg not downloaded yet
2026-03-24 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962a090>
2026-03-24 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/3.jpg saved to cache
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938e4d0>
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/9.jpg saved to cache
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfc290>
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/5.jpg saved to cache
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938e2d0>
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/8.jpg saved to cache
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7a90>
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/4.jpg saved to cache
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdacd0>
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/2.jpg saved to cache
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/5.jpg not downloaded yet
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/6.jpg not downloaded yet
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009193790>
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/6.jpg saved to cache
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/7.jpg not downloaded yet
2026-03-24 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/8.jpg not downloaded yet
2026-03-24 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/9.jpg not downloaded yet
2026-03-24 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/10.jpg not downloaded yet
2026-03-24 22:49:38 [ayvens.be] INFO: Found listing with ID: 1980255
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980255%27 HTTP/1.1" 200 None
2026-03-24 22:49:38 [ayvens.be] INFO: Scrape type for 1980255: 1
2026-03-24 22:49:38 [ayvens.be] INFO: Extracting data for car ID: 1980255
2026-03-24 22:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1980255
2026-03-24 22:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with scrape type 1
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/1.jpg not downloaded yet
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/2.jpg not downloaded yet
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf7a50>
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/6.jpg saved to cache
2026-03-24 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/3.jpg not downloaded yet
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/4.jpg not downloaded yet
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/5.jpg not downloaded yet
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097893d0>
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/5.jpg saved to cache
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449f90>
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/2.jpg saved to cache
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a0690>
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/3.jpg saved to cache
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b390>
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/7.jpg saved to cache
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009448a90>
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/1.jpg saved to cache
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009157990>
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/4.jpg saved to cache
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a1950>
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F977f8f9590154c62990273fe200e3623%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/10.jpg saved to cache
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02
2026-03-24 22:49:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02, skipping ID generation
2026-03-24 22:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with scrape type 1
2026-03-24 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 sending to next pipeline
2026-03-24 22:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02, identifier: 1980252
2026-03-24 22:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1980252
2026-03-24 22:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1980252
2026-03-24 22:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1980252 to the API
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b30eb02b-510e-5cce-8b0c-c2f43e8c5e02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 54790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30eb02b-510e-5cce-8b0c-c2f43e8c5e02/b30eb02b-510e-5cce-8b0c-c2f43e8c5e02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/977f8f9590154c62990273fe200e3623/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980252%27 HTTP/1.1" 200 None
2026-03-24 22:49:40 [ayvens.be] INFO: Saving data for 1980252: {'created_time': 1774392580.303836, 'last_price_update_time': 1774392580.303845, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980252') HTTP/1.1" 204 0
2026-03-24 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/6.jpg not downloaded yet
2026-03-24 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/7.jpg not downloaded yet
2026-03-24 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/8.jpg not downloaded yet
2026-03-24 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/9.jpg not downloaded yet
2026-03-24 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/10.jpg not downloaded yet
2026-03-24 22:49:40 [ayvens.be] INFO: Found listing with ID: 1980256
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980256%27 HTTP/1.1" 200 None
2026-03-24 22:49:40 [ayvens.be] INFO: Scrape type for 1980256: 1
2026-03-24 22:49:40 [ayvens.be] INFO: Extracting data for car ID: 1980256
2026-03-24 22:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1980256
2026-03-24 22:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85724f90-0dfe-56d9-843c-ec02c68eed02 with scrape type 1
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/1.jpg not downloaded yet
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2a10>
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/10.jpg saved to cache
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/2.jpg not downloaded yet
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fb5d0>
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/9.jpg saved to cache
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d6110>
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/3.jpg saved to cache
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310450>
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fd69fe3c614564ee7926bbbe7b816a0ba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/8.jpg saved to cache
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596
2026-03-24 22:49:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596, skipping ID generation
2026-03-24 22:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with scrape type 1
2026-03-24 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 sending to next pipeline
2026-03-24 22:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596, identifier: 1980253
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6cd910>
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/1.jpg saved to cache
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeac950>
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/5.jpg saved to cache
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c3a10>
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/2.jpg saved to cache
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095abed0>
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/4.jpg saved to cache
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/3.jpg not downloaded yet
2026-03-24 22:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with identifier: 1980253
2026-03-24 22:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with identifier: 1980253
2026-03-24 22:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with identifier: 1980253 to the API
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '71cde7f2-aa02-5bb5-a9d0-0db0d127d596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 109444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71cde7f2-aa02-5bb5-a9d0-0db0d127d596/71cde7f2-aa02-5bb5-a9d0-0db0d127d596_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/d69fe3c614564ee7926bbbe7b816a0ba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980253%27 HTTP/1.1" 200 None
2026-03-24 22:49:41 [ayvens.be] INFO: Saving data for 1980253: {'created_time': 1774392581.824697, 'last_price_update_time': 1774392581.824708, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980253') HTTP/1.1" 204 0
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/4.jpg not downloaded yet
2026-03-24 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/5.jpg not downloaded yet
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/6.jpg not downloaded yet
2026-03-24 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/7.jpg not downloaded yet
2026-03-24 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/8.jpg not downloaded yet
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/9.jpg not downloaded yet
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/10.jpg not downloaded yet
2026-03-24 22:49:41 [ayvens.be] INFO: Found listing with ID: 1980257
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980257%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [ayvens.be] INFO: Scrape type for 1980257: 1
2026-03-24 22:49:42 [ayvens.be] INFO: Extracting data for car ID: 1980257
2026-03-24 22:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1980257
2026-03-24 22:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d047eea3-306f-5f94-83ed-56eb33ac1de2 with scrape type 1
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/1.jpg not downloaded yet
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962de50>
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/6.jpg saved to cache
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b9010>
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/5.jpg saved to cache
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978a750>
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/3.jpg saved to cache
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d03210>
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/4.jpg saved to cache
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962db90>
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/2.jpg saved to cache
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/2.jpg not downloaded yet
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/3.jpg not downloaded yet
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335910>
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/7.jpg saved to cache
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7610>
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/6.jpg saved to cache
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009186410>
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/8.jpg saved to cache
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/4.jpg not downloaded yet
2026-03-24 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/5.jpg not downloaded yet
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/6.jpg not downloaded yet
2026-03-24 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/7.jpg not downloaded yet
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/8.jpg not downloaded yet
2026-03-24 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/9.jpg not downloaded yet
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fabd0>
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/1.jpg saved to cache
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bae50>
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/7.jpg saved to cache
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915c690>
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/3.jpg saved to cache
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838e7d0>
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/10.jpg saved to cache
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/10.jpg not downloaded yet
2026-03-24 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:43 [ayvens.be] INFO: Found listing with ID: 1980258
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980258%27 HTTP/1.1" 200 None
2026-03-24 22:49:43 [ayvens.be] INFO: Scrape type for 1980258: 1
2026-03-24 22:49:43 [ayvens.be] INFO: Extracting data for car ID: 1980258
2026-03-24 22:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1980258
2026-03-24 22:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b87bb0-cccb-5170-837d-4e434418cb6c with scrape type 1
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/1.jpg not downloaded yet
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915f510>
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/1.jpg saved to cache
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfdc90>
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/2.jpg saved to cache
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144d50>
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/10.jpg saved to cache
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfc610>
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4618e33d1a52411285f5a355070347af%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/9.jpg saved to cache
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 773e2031-4730-5eec-ada3-05f112376a35
2026-03-24 22:49:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 773e2031-4730-5eec-ada3-05f112376a35, skipping ID generation
2026-03-24 22:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773e2031-4730-5eec-ada3-05f112376a35 with scrape type 1
2026-03-24 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 773e2031-4730-5eec-ada3-05f112376a35 sending to next pipeline
2026-03-24 22:49:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 773e2031-4730-5eec-ada3-05f112376a35, identifier: 1980254
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008312e90>
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/6.jpg saved to cache
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1980254
2026-03-24 22:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1980254
2026-03-24 22:49:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1980254 to the API
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '773e2031-4730-5eec-ada3-05f112376a35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 77912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 854353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773e2031-4730-5eec-ada3-05f112376a35/773e2031-4730-5eec-ada3-05f112376a35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4618e33d1a52411285f5a355070347af/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980254%27 HTTP/1.1" 200 None
2026-03-24 22:49:44 [ayvens.be] INFO: Saving data for 1980254: {'created_time': 1774392584.399414, 'last_price_update_time': 1774392584.399424, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980254') HTTP/1.1" 204 0
2026-03-24 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/2.jpg not downloaded yet
2026-03-24 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/3.jpg not downloaded yet
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a31d0>
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/4.jpg saved to cache
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3ad0>
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/8.jpg saved to cache
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8ed0>
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8695ee879b904169bd3fedeb9515a50c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/9.jpg saved to cache
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6
2026-03-24 22:49:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b0f1bfc-61ef-5df4-9193-0b96111023d6, skipping ID generation
2026-03-24 22:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with scrape type 1
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6 sending to next pipeline
2026-03-24 22:49:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5b0f1bfc-61ef-5df4-9193-0b96111023d6, identifier: 1980255
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946cf50>
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/5.jpg saved to cache
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/4.jpg not downloaded yet
2026-03-24 22:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1980255
2026-03-24 22:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1980255
2026-03-24 22:49:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1980255 to the API
2026-03-24 22:49:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '5b0f1bfc-61ef-5df4-9193-0b96111023d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Golf',
 'odometer': 123123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0f1bfc-61ef-5df4-9193-0b96111023d6/5b0f1bfc-61ef-5df4-9193-0b96111023d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8695ee879b904169bd3fedeb9515a50c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Golf 2.0 TDI 110KW DSG LIFE',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW DSG LIFE',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980255%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [ayvens.be] INFO: Saving data for 1980255: {'created_time': 1774392585.148626, 'last_price_update_time': 1774392585.148636, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980255') HTTP/1.1" 204 0
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/5.jpg not downloaded yet
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e750>
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/7.jpg saved to cache
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b2b50>
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/9.jpg saved to cache
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed0250>
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/8.jpg saved to cache
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/6.jpg not downloaded yet
2026-03-24 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/7.jpg not downloaded yet
2026-03-24 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/8.jpg not downloaded yet
2026-03-24 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/9.jpg not downloaded yet
2026-03-24 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/10.jpg not downloaded yet
2026-03-24 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:45 [ayvens.be] INFO: Found listing with ID: 1980259
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980259%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [ayvens.be] INFO: Scrape type for 1980259: 1
2026-03-24 22:49:45 [ayvens.be] INFO: Extracting data for car ID: 1980259
2026-03-24 22:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc39b1ac-7f25-5b74-bf05-330c85f41744 with identifier: 1980259
2026-03-24 22:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc39b1ac-7f25-5b74-bf05-330c85f41744 with scrape type 1
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/1.jpg not downloaded yet
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788910>
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F328b00593a2f419f8c988b7b7c5a882b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/10.jpg saved to cache
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85724f90-0dfe-56d9-843c-ec02c68eed02
2026-03-24 22:49:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85724f90-0dfe-56d9-843c-ec02c68eed02, skipping ID generation
2026-03-24 22:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85724f90-0dfe-56d9-843c-ec02c68eed02 with scrape type 1
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85724f90-0dfe-56d9-843c-ec02c68eed02 sending to next pipeline
2026-03-24 22:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85724f90-0dfe-56d9-843c-ec02c68eed02, identifier: 1980256
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/2.jpg not downloaded yet
2026-03-24 22:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1980256
2026-03-24 22:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1980256
2026-03-24 22:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1980256 to the API
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '85724f90-0dfe-56d9-843c-ec02c68eed02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 126988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85724f90-0dfe-56d9-843c-ec02c68eed02/85724f90-0dfe-56d9-843c-ec02c68eed02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/328b00593a2f419f8c988b7b7c5a882b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980256%27 HTTP/1.1" 200 None
2026-03-24 22:49:46 [ayvens.be] INFO: Saving data for 1980256: {'created_time': 1774392586.023156, 'last_price_update_time': 1774392586.023166, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980256') HTTP/1.1" 204 0
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7bd0>
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/3.jpg saved to cache
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009942390>
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/1.jpg saved to cache
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/3.jpg not downloaded yet
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bef50>
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/2.jpg saved to cache
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02ad0>
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/4.jpg saved to cache
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfc090>
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/7.jpg saved to cache
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083abbd0>
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/5.jpg saved to cache
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338150>
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/6.jpg saved to cache
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/4.jpg not downloaded yet
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/5.jpg not downloaded yet
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/6.jpg not downloaded yet
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/7.jpg not downloaded yet
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/8.jpg not downloaded yet
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/9.jpg not downloaded yet
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/10.jpg not downloaded yet
2026-03-24 22:49:47 [ayvens.be] INFO: Found listing with ID: 1980260
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980260%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [ayvens.be] INFO: Scrape type for 1980260: 1
2026-03-24 22:49:47 [ayvens.be] INFO: Extracting data for car ID: 1980260
2026-03-24 22:49:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1980260
2026-03-24 22:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641cc868-a13f-553c-85d9-2731744fa2f3 with scrape type 1
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/1.jpg not downloaded yet
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/2.jpg not downloaded yet
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d022d0>
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/3.jpg saved to cache
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096df610>
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/5.jpg saved to cache
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed1910>
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/2.jpg saved to cache
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094648d0>
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/10.jpg saved to cache
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343710>
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/4.jpg saved to cache
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098705d0>
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/1.jpg saved to cache
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/3.jpg not downloaded yet
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/4.jpg not downloaded yet
2026-03-24 22:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/5.jpg not downloaded yet
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761010>
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/9.jpg saved to cache
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bdad7d0>
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F32cc1ddaa10a41d2b059908349ce2eb0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/8.jpg saved to cache
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d047eea3-306f-5f94-83ed-56eb33ac1de2
2026-03-24 22:49:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d047eea3-306f-5f94-83ed-56eb33ac1de2, skipping ID generation
2026-03-24 22:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d047eea3-306f-5f94-83ed-56eb33ac1de2 with scrape type 1
2026-03-24 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d047eea3-306f-5f94-83ed-56eb33ac1de2 sending to next pipeline
2026-03-24 22:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d047eea3-306f-5f94-83ed-56eb33ac1de2, identifier: 1980257
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008339350>
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/3.jpg saved to cache
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1980257
2026-03-24 22:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1980257
2026-03-24 22:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1980257 to the API
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd047eea3-306f-5f94-83ed-56eb33ac1de2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 74124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d047eea3-306f-5f94-83ed-56eb33ac1de2/d047eea3-306f-5f94-83ed-56eb33ac1de2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/32cc1ddaa10a41d2b059908349ce2eb0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980257%27 HTTP/1.1" 200 None
2026-03-24 22:49:48 [ayvens.be] INFO: Saving data for 1980257: {'created_time': 1774392588.432627, 'last_price_update_time': 1774392588.432637, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980257') HTTP/1.1" 204 0
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/6.jpg not downloaded yet
2026-03-24 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/7.jpg not downloaded yet
2026-03-24 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915fe50>
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/2.jpg saved to cache
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641410>
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/1.jpg saved to cache
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/8.jpg not downloaded yet
2026-03-24 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/9.jpg not downloaded yet
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008337310>
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/5.jpg saved to cache
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405890>
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/10.jpg saved to cache
2026-03-24 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009718610>
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/7.jpg saved to cache
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407a90>
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/6.jpg saved to cache
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfe790>
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/9.jpg saved to cache
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/10.jpg not downloaded yet
2026-03-24 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:49 [ayvens.be] INFO: Found listing with ID: 1980261
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980261%27 HTTP/1.1" 200 None
2026-03-24 22:49:49 [ayvens.be] INFO: Scrape type for 1980261: 1
2026-03-24 22:49:49 [ayvens.be] INFO: Extracting data for car ID: 1980261
2026-03-24 22:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1980261
2026-03-24 22:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb29561-e158-5223-bfca-38b14132c135 with scrape type 1
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/1.jpg not downloaded yet
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2b90>
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Fe703d8762a274d31968ba403a65dccb2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/8.jpg saved to cache
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70b87bb0-cccb-5170-837d-4e434418cb6c
2026-03-24 22:49:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70b87bb0-cccb-5170-837d-4e434418cb6c, skipping ID generation
2026-03-24 22:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b87bb0-cccb-5170-837d-4e434418cb6c with scrape type 1
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70b87bb0-cccb-5170-837d-4e434418cb6c sending to next pipeline
2026-03-24 22:49:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70b87bb0-cccb-5170-837d-4e434418cb6c, identifier: 1980258
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d19d0>
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/6.jpg saved to cache
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834f910>
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/4.jpg saved to cache
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/2.jpg not downloaded yet
2026-03-24 22:49:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1980258
2026-03-24 22:49:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1980258
2026-03-24 22:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1980258 to the API
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '70b87bb0-cccb-5170-837d-4e434418cb6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 75053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b87bb0-cccb-5170-837d-4e434418cb6c/70b87bb0-cccb-5170-837d-4e434418cb6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/e703d8762a274d31968ba403a65dccb2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 PLUS DARK DESIGN AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 PLUS DARK DESIGN AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980258%27 HTTP/1.1" 200 None
2026-03-24 22:49:49 [ayvens.be] INFO: Saving data for 1980258: {'created_time': 1774392589.955766, 'last_price_update_time': 1774392589.955776, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980258') HTTP/1.1" 204 0
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/3.jpg not downloaded yet
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/4.jpg not downloaded yet
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091873d0>
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/9.jpg saved to cache
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915dad0>
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/10.jpg saved to cache
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b9910>
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/8.jpg saved to cache
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963bc50>
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F101537d1811e4d179ef81b7874d56e2d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/7.jpg saved to cache
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc39b1ac-7f25-5b74-bf05-330c85f41744
2026-03-24 22:49:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc39b1ac-7f25-5b74-bf05-330c85f41744, skipping ID generation
2026-03-24 22:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc39b1ac-7f25-5b74-bf05-330c85f41744 with scrape type 1
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc39b1ac-7f25-5b74-bf05-330c85f41744 sending to next pipeline
2026-03-24 22:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dc39b1ac-7f25-5b74-bf05-330c85f41744, identifier: 1980259
2026-03-24 22:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dc39b1ac-7f25-5b74-bf05-330c85f41744 with identifier: 1980259
2026-03-24 22:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dc39b1ac-7f25-5b74-bf05-330c85f41744 with identifier: 1980259
2026-03-24 22:49:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dc39b1ac-7f25-5b74-bf05-330c85f41744 with identifier: 1980259 to the API
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc39b1ac-7f25-5b74-bf05-330c85f41744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 200210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39b1ac-7f25-5b74-bf05-330c85f41744/dc39b1ac-7f25-5b74-bf05-330c85f41744_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/101537d1811e4d179ef81b7874d56e2d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 D165 MHEV S 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 D165 MHEV S 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980259%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [ayvens.be] INFO: Saving data for 1980259: {'created_time': 1774392590.704586, 'last_price_update_time': 1774392590.704597, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980259') HTTP/1.1" 204 0
2026-03-24 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/5.jpg not downloaded yet
2026-03-24 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/6.jpg not downloaded yet
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/7.jpg not downloaded yet
2026-03-24 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/8.jpg not downloaded yet
2026-03-24 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/9.jpg not downloaded yet
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/10.jpg not downloaded yet
2026-03-24 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b26d0>
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/2.jpg saved to cache
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:50 [ayvens.be] INFO: Found listing with ID: 1980262
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980262%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [ayvens.be] INFO: Scrape type for 1980262: 1
2026-03-24 22:49:50 [ayvens.be] INFO: Extracting data for car ID: 1980262
2026-03-24 22:49:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21bf7132-43ae-581a-92d0-43010c2c45ae with identifier: 1980262
2026-03-24 22:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21bf7132-43ae-581a-92d0-43010c2c45ae with scrape type 1
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/1.jpg not downloaded yet
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406250>
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/1.jpg saved to cache
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338150>
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/3.jpg saved to cache
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/2.jpg not downloaded yet
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/3.jpg not downloaded yet
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685550>
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/4.jpg saved to cache
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cfc50>
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/6.jpg saved to cache
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009185e90>
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/7.jpg saved to cache
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7990>
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/5.jpg saved to cache
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009790d50>
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/8.jpg saved to cache
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/4.jpg not downloaded yet
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/5.jpg not downloaded yet
2026-03-24 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/6.jpg not downloaded yet
2026-03-24 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/7.jpg not downloaded yet
2026-03-24 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/8.jpg not downloaded yet
2026-03-24 22:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/9.jpg not downloaded yet
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/10.jpg not downloaded yet
2026-03-24 22:49:51 [ayvens.be] INFO: Found listing with ID: 1980263
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980263%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [ayvens.be] INFO: Scrape type for 1980263: 1
2026-03-24 22:49:51 [ayvens.be] INFO: Extracting data for car ID: 1980263
2026-03-24 22:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1980263
2026-03-24 22:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5926a4-868d-51d5-b909-123e0d888f17 with scrape type 1
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/1.jpg not downloaded yet
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967d310>
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/1.jpg saved to cache
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4dd0>
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/2.jpg saved to cache
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fbc10>
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/10.jpg saved to cache
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/2.jpg not downloaded yet
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915ec10>
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fe597cb796ce54264b250b25be8c872cd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/9.jpg saved to cache
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 641cc868-a13f-553c-85d9-2731744fa2f3
2026-03-24 22:49:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 641cc868-a13f-553c-85d9-2731744fa2f3, skipping ID generation
2026-03-24 22:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641cc868-a13f-553c-85d9-2731744fa2f3 with scrape type 1
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 641cc868-a13f-553c-85d9-2731744fa2f3 sending to next pipeline
2026-03-24 22:49:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 641cc868-a13f-553c-85d9-2731744fa2f3, identifier: 1980260
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b3050>
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/4.jpg saved to cache
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128650>
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/3.jpg saved to cache
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938d850>
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/5.jpg saved to cache
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/3.jpg not downloaded yet
2026-03-24 22:49:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1980260
2026-03-24 22:49:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1980260
2026-03-24 22:49:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1980260 to the API
2026-03-24 22:49:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '641cc868-a13f-553c-85d9-2731744fa2f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 116371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_641cc868-a13f-553c-85d9-2731744fa2f3/641cc868-a13f-553c-85d9-2731744fa2f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/e597cb796ce54264b250b25be8c872cd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980260%27 HTTP/1.1" 200 None
2026-03-24 22:49:53 [ayvens.be] INFO: Saving data for 1980260: {'created_time': 1774392593.123285, 'last_price_update_time': 1774392593.123295, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980260') HTTP/1.1" 204 0
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/4.jpg not downloaded yet
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938fad0>
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/6.jpg saved to cache
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/5.jpg not downloaded yet
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019b50>
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/2.jpg saved to cache
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/6.jpg not downloaded yet
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008327110>
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/1.jpg saved to cache
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449a50>
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/3.jpg saved to cache
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/7.jpg not downloaded yet
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/8.jpg not downloaded yet
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c0310>
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/10.jpg saved to cache
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761890>
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/8.jpg saved to cache
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/9.jpg not downloaded yet
2026-03-24 22:49:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/10.jpg not downloaded yet
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372850>
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/4.jpg saved to cache
2026-03-24 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473dd0>
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/7.jpg saved to cache
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009120f50>
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F447a2d5aca0d4045aef810e510a74574%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/9.jpg saved to cache
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aeb29561-e158-5223-bfca-38b14132c135
2026-03-24 22:49:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aeb29561-e158-5223-bfca-38b14132c135, skipping ID generation
2026-03-24 22:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb29561-e158-5223-bfca-38b14132c135 with scrape type 1
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aeb29561-e158-5223-bfca-38b14132c135 sending to next pipeline
2026-03-24 22:49:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aeb29561-e158-5223-bfca-38b14132c135, identifier: 1980261
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1dfa10>
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/2.jpg saved to cache
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:54 [ayvens.be] INFO: Found listing with ID: 1980264
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980264%27 HTTP/1.1" 200 None
2026-03-24 22:49:54 [ayvens.be] INFO: Scrape type for 1980264: 1
2026-03-24 22:49:54 [ayvens.be] INFO: Extracting data for car ID: 1980264
2026-03-24 22:49:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1980264
2026-03-24 22:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with scrape type 1
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/1.jpg not downloaded yet
2026-03-24 22:49:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1980261
2026-03-24 22:49:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1980261
2026-03-24 22:49:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1980261 to the API
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'aeb29561-e158-5223-bfca-38b14132c135',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 63948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aeb29561-e158-5223-bfca-38b14132c135/aeb29561-e158-5223-bfca-38b14132c135_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/447a2d5aca0d4045aef810e510a74574/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980261%27 HTTP/1.1" 200 None
2026-03-24 22:49:54 [ayvens.be] INFO: Saving data for 1980261: {'created_time': 1774392594.640073, 'last_price_update_time': 1774392594.640083, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980261') HTTP/1.1" 204 0
2026-03-24 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/2.jpg not downloaded yet
2026-03-24 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/3.jpg not downloaded yet
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962d250>
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/5.jpg saved to cache
2026-03-24 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3c50>
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/1.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962ae10>
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/6.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/4.jpg not downloaded yet
2026-03-24 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/5.jpg not downloaded yet
2026-03-24 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a00d0>
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/10.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449490>
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/4.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cf950>
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/3.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/6.jpg not downloaded yet
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/7.jpg not downloaded yet
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838cf50>
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/9.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9950>
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/5.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838f350>
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/6.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009192890>
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/8.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e650>
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F6062909c9a384c8db5c7e2774c6bed94%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/7.jpg saved to cache
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21bf7132-43ae-581a-92d0-43010c2c45ae
2026-03-24 22:49:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21bf7132-43ae-581a-92d0-43010c2c45ae, skipping ID generation
2026-03-24 22:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21bf7132-43ae-581a-92d0-43010c2c45ae with scrape type 1
2026-03-24 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21bf7132-43ae-581a-92d0-43010c2c45ae sending to next pipeline
2026-03-24 22:49:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 21bf7132-43ae-581a-92d0-43010c2c45ae, identifier: 1980262
2026-03-24 22:49:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 21bf7132-43ae-581a-92d0-43010c2c45ae with identifier: 1980262
2026-03-24 22:49:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 21bf7132-43ae-581a-92d0-43010c2c45ae with identifier: 1980262
2026-03-24 22:49:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 21bf7132-43ae-581a-92d0-43010c2c45ae with identifier: 1980262 to the API
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '21bf7132-43ae-581a-92d0-43010c2c45ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 145722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21bf7132-43ae-581a-92d0-43010c2c45ae/21bf7132-43ae-581a-92d0-43010c2c45ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/6062909c9a384c8db5c7e2774c6bed94/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2021}
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980262%27 HTTP/1.1" 200 None
2026-03-24 22:49:56 [ayvens.be] INFO: Saving data for 1980262: {'created_time': 1774392596.061092, 'last_price_update_time': 1774392596.061104, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980262') HTTP/1.1" 204 0
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/8.jpg not downloaded yet
2026-03-24 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/9.jpg not downloaded yet
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ab690>
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/7.jpg saved to cache
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/10.jpg not downloaded yet
2026-03-24 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:56 [ayvens.be] INFO: Found listing with ID: 1980265
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980265%27 HTTP/1.1" 200 None
2026-03-24 22:49:56 [ayvens.be] INFO: Scrape type for 1980265: 1
2026-03-24 22:49:56 [ayvens.be] INFO: Extracting data for car ID: 1980265
2026-03-24 22:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1980265
2026-03-24 22:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with scrape type 1
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/1.jpg not downloaded yet
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b9910>
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/9.jpg saved to cache
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e0450>
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/10.jpg saved to cache
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/2.jpg not downloaded yet
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfc390>
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F3e871e72f107451ca2306b9807f60085%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/8.jpg saved to cache
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f5926a4-868d-51d5-b909-123e0d888f17
2026-03-24 22:49:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f5926a4-868d-51d5-b909-123e0d888f17, skipping ID generation
2026-03-24 22:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5926a4-868d-51d5-b909-123e0d888f17 with scrape type 1
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f5926a4-868d-51d5-b909-123e0d888f17 sending to next pipeline
2026-03-24 22:49:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f5926a4-868d-51d5-b909-123e0d888f17, identifier: 1980263
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aba10>
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/1.jpg saved to cache
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095a8110>
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/2.jpg saved to cache
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/3.jpg not downloaded yet
2026-03-24 22:49:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1980263
2026-03-24 22:49:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1980263
2026-03-24 22:49:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1980263 to the API
2026-03-24 22:49:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f5926a4-868d-51d5-b909-123e0d888f17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 114303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5926a4-868d-51d5-b909-123e0d888f17/0f5926a4-868d-51d5-b909-123e0d888f17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/3e871e72f107451ca2306b9807f60085/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.6 E-TECH PLUG-IN HYBRID INITIALE PARIS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH PLUG-IN HYBRID INITIALE PARIS',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980263%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [ayvens.be] INFO: Saving data for 1980263: {'created_time': 1774392597.14881, 'last_price_update_time': 1774392597.14882, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980263') HTTP/1.1" 204 0
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/4.jpg not downloaded yet
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915f610>
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/3.jpg saved to cache
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761cd0>
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/5.jpg saved to cache
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009140ed0>
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/4.jpg saved to cache
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/5.jpg not downloaded yet
2026-03-24 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/6.jpg not downloaded yet
2026-03-24 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/7.jpg not downloaded yet
2026-03-24 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/8.jpg not downloaded yet
2026-03-24 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/9.jpg not downloaded yet
2026-03-24 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/10.jpg not downloaded yet
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938dcd0>
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/7.jpg saved to cache
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a95d0>
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/6.jpg saved to cache
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:57 [ayvens.be] INFO: Found listing with ID: 1980266
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980266%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [ayvens.be] INFO: Scrape type for 1980266: 1
2026-03-24 22:49:57 [ayvens.be] INFO: Extracting data for car ID: 1980266
2026-03-24 22:49:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1980266
2026-03-24 22:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ff5c32-098b-5760-9181-7ea2e0123afc with scrape type 1
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/1.jpg not downloaded yet
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900bfd0>
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/8.jpg saved to cache
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/2.jpg not downloaded yet
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/3.jpg not downloaded yet
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911e850>
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/9.jpg saved to cache
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964c350>
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F86d859d1671e4fb69e19d7f9eb78fc02%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/10.jpg saved to cache
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5
2026-03-24 22:49:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5, skipping ID generation
2026-03-24 22:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with scrape type 1
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 sending to next pipeline
2026-03-24 22:49:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5, identifier: 1980264
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b63a090>
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/1.jpg saved to cache
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009763bd0>
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/2.jpg saved to cache
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1980264
2026-03-24 22:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1980264
2026-03-24 22:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1980264 to the API
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 74237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5/c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/86d859d1671e4fb69e19d7f9eb78fc02/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980264%27 HTTP/1.1" 200 None
2026-03-24 22:49:58 [ayvens.be] INFO: Saving data for 1980264: {'created_time': 1774392598.789259, 'last_price_update_time': 1774392598.789268, 'auction_closing_time': 1774530000.0}
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980264') HTTP/1.1" 204 0
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/4.jpg not downloaded yet
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/5.jpg not downloaded yet
2026-03-24 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097730d0>
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/3.jpg saved to cache
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009611490>
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/4.jpg saved to cache
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/6.jpg not downloaded yet
2026-03-24 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/7.jpg not downloaded yet
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009758c90>
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/6.jpg saved to cache
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/8.jpg not downloaded yet
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/9.jpg not downloaded yet
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912b290>
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/5.jpg saved to cache
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912a990>
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/7.jpg saved to cache
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a8f50>
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/8.jpg saved to cache
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009185ed0>
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/9.jpg saved to cache
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/10.jpg not downloaded yet
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1810>
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F242f583b914a41b0adf70eacd266b89d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/10.jpg saved to cache
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66
2026-03-24 22:49:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dfdf38a-a3e5-5784-828a-f0c31612ee66, skipping ID generation
2026-03-24 22:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with scrape type 1
2026-03-24 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66 sending to next pipeline
2026-03-24 22:49:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0dfdf38a-a3e5-5784-828a-f0c31612ee66, identifier: 1980265
2026-03-24 22:49:59 [ayvens.be] INFO: Found listing with ID: 1980267
2026-03-24 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980267%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [ayvens.be] INFO: Scrape type for 1980267: 1
2026-03-24 22:50:00 [ayvens.be] INFO: Extracting data for car ID: 1980267
2026-03-24 22:50:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1980267
2026-03-24 22:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with scrape type 1
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/1.jpg not downloaded yet
2026-03-24 22:50:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1980265
2026-03-24 22:50:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1980265
2026-03-24 22:50:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1980265 to the API
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '0dfdf38a-a3e5-5784-828a-f0c31612ee66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 42466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dfdf38a-a3e5-5784-828a-f0c31612ee66/0dfdf38a-a3e5-5784-828a-f0c31612ee66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/242f583b914a41b0adf70eacd266b89d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980265%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [ayvens.be] INFO: Saving data for 1980265: {'created_time': 1774392600.377467, 'last_price_update_time': 1774392600.377476, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980265') HTTP/1.1" 204 0
2026-03-24 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/2.jpg not downloaded yet
2026-03-24 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/3.jpg not downloaded yet
2026-03-24 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/4.jpg not downloaded yet
2026-03-24 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/5.jpg not downloaded yet
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/6.jpg not downloaded yet
2026-03-24 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/7.jpg not downloaded yet
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d5850>
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/1.jpg saved to cache
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449110>
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/2.jpg saved to cache
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/8.jpg not downloaded yet
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c11d0>
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/5.jpg saved to cache
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/9.jpg not downloaded yet
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cea10>
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/3.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3690>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/4.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760f50>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/7.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009141090>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/6.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963a1d0>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/8.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/10.jpg not downloaded yet
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [ayvens.be] INFO: Found listing with ID: 1980268
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980268%27 HTTP/1.1" 200 None
2026-03-24 22:50:01 [ayvens.be] INFO: Scrape type for 1980268: 1
2026-03-24 22:50:01 [ayvens.be] INFO: Extracting data for car ID: 1980268
2026-03-24 22:50:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1980268
2026-03-24 22:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4861b22-3a31-5b05-984b-5666753bb4c0 with scrape type 1
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/1.jpg not downloaded yet
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/2.jpg not downloaded yet
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/3.jpg not downloaded yet
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/4.jpg not downloaded yet
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962ae90>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/3.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128fd0>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/2.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008315e90>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/1.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/5.jpg not downloaded yet
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962b7d0>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/4.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/6.jpg not downloaded yet
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008398750>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/5.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e1cd0>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/9.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c7650>
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F8b7a2d2944a24af98ff36d2449ff8c3d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/10.jpg saved to cache
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84ff5c32-098b-5760-9181-7ea2e0123afc
2026-03-24 22:50:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84ff5c32-098b-5760-9181-7ea2e0123afc, skipping ID generation
2026-03-24 22:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ff5c32-098b-5760-9181-7ea2e0123afc with scrape type 1
2026-03-24 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84ff5c32-098b-5760-9181-7ea2e0123afc sending to next pipeline
2026-03-24 22:50:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 84ff5c32-098b-5760-9181-7ea2e0123afc, identifier: 1980266
2026-03-24 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/7.jpg not downloaded yet
2026-03-24 22:50:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1980266
2026-03-24 22:50:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1980266
2026-03-24 22:50:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1980266 to the API
2026-03-24 22:50:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '84ff5c32-098b-5760-9181-7ea2e0123afc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQB',
 'odometer': 49153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84ff5c32-098b-5760-9181-7ea2e0123afc/84ff5c32-098b-5760-9181-7ea2e0123afc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/8b7a2d2944a24af98ff36d2449ff8c3d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQB BEV 67KWH EQB 300 AMG LINE AUTO 4M',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQB 300 AMG LINE AUTO 4M',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980266%27 HTTP/1.1" 200 None
2026-03-24 22:50:04 [ayvens.be] INFO: Saving data for 1980266: {'created_time': 1774392604.192612, 'last_price_update_time': 1774392604.192622, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980266') HTTP/1.1" 204 0
2026-03-24 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/8.jpg not downloaded yet
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008387c10>
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/8.jpg saved to cache
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009421e10>
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/6.jpg saved to cache
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013f10>
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/7.jpg saved to cache
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/9.jpg not downloaded yet
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/10.jpg not downloaded yet
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f53d0>
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/10.jpg saved to cache
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112650>
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F90a46d57804346bf99055ee4b972761d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/9.jpg saved to cache
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7
2026-03-24 22:50:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7, skipping ID generation
2026-03-24 22:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with scrape type 1
2026-03-24 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 sending to next pipeline
2026-03-24 22:50:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7, identifier: 1980267
2026-03-24 22:50:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1980267
2026-03-24 22:50:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1980267
2026-03-24 22:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1980267 to the API
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8e32f3c2-1201-53f9-a2fc-ea44d56970a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 91408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e32f3c2-1201-53f9-a2fc-ea44d56970a7/8e32f3c2-1201-53f9-a2fc-ea44d56970a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/90a46d57804346bf99055ee4b972761d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2023}
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980267%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [ayvens.be] INFO: Saving data for 1980267: {'created_time': 1774392605.080227, 'last_price_update_time': 1774392605.080237, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980267') HTTP/1.1" 204 0
2026-03-24 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:05 [ayvens.be] INFO: Found listing with ID: 1980269
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980269%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [ayvens.be] INFO: Scrape type for 1980269: 1
2026-03-24 22:50:05 [ayvens.be] INFO: Extracting data for car ID: 1980269
2026-03-24 22:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 199ab21c-1cd9-5623-98ea-15f33b9eca6e with identifier: 1980269
2026-03-24 22:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e with scrape type 1
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/1.jpg not downloaded yet
2026-03-24 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/2.jpg not downloaded yet
2026-03-24 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/3.jpg not downloaded yet
2026-03-24 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/4.jpg not downloaded yet
2026-03-24 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/5.jpg not downloaded yet
2026-03-24 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/6.jpg not downloaded yet
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/7.jpg not downloaded yet
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422d10>
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/2.jpg saved to cache
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/8.jpg not downloaded yet
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/9.jpg not downloaded yet
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bfc10>
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/3.jpg saved to cache
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119d10>
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/1.jpg saved to cache
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed8250>
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/5.jpg saved to cache
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d947d0>
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/4.jpg saved to cache
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009118fd0>
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/6.jpg saved to cache
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873a90>
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/7.jpg saved to cache
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/10.jpg not downloaded yet
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009118e90>
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/8.jpg saved to cache
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:06 [ayvens.be] INFO: Found listing with ID: 1980270
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980270%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [ayvens.be] INFO: Scrape type for 1980270: 1
2026-03-24 22:50:06 [ayvens.be] INFO: Extracting data for car ID: 1980270
2026-03-24 22:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1980270
2026-03-24 22:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with scrape type 1
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/1.jpg not downloaded yet
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/2.jpg not downloaded yet
2026-03-24 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/3.jpg not downloaded yet
2026-03-24 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/4.jpg not downloaded yet
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/5.jpg not downloaded yet
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/6.jpg not downloaded yet
2026-03-24 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/7.jpg not downloaded yet
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/8.jpg not downloaded yet
2026-03-24 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0310>
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/1.jpg saved to cache
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083697d0>
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/10.jpg saved to cache
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008358dd0>
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/3.jpg saved to cache
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdbc10>
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/2.jpg saved to cache
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b590>
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fb35329317ca64dffab0f57db04323eeb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/9.jpg saved to cache
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4861b22-3a31-5b05-984b-5666753bb4c0
2026-03-24 22:50:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4861b22-3a31-5b05-984b-5666753bb4c0, skipping ID generation
2026-03-24 22:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4861b22-3a31-5b05-984b-5666753bb4c0 with scrape type 1
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4861b22-3a31-5b05-984b-5666753bb4c0 sending to next pipeline
2026-03-24 22:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b4861b22-3a31-5b05-984b-5666753bb4c0, identifier: 1980268
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/9.jpg not downloaded yet
2026-03-24 22:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1980268
2026-03-24 22:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1980268
2026-03-24 22:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1980268 to the API
2026-03-24 22:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b4861b22-3a31-5b05-984b-5666753bb4c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 65837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4861b22-3a31-5b05-984b-5666753bb4c0/b4861b22-3a31-5b05-984b-5666753bb4c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/b35329317ca64dffab0f57db04323eeb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980268%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [ayvens.be] INFO: Saving data for 1980268: {'created_time': 1774392607.185335, 'last_price_update_time': 1774392607.185344, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980268') HTTP/1.1" 204 0
2026-03-24 22:50:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 4 pages/min), scraped 258 items (at 42 items/min)
2026-03-24 22:50:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3450>
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/4.jpg saved to cache
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/10.jpg not downloaded yet
2026-03-24 22:50:07 [ayvens.be] INFO: Found listing with ID: 1980271
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980271%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [ayvens.be] INFO: Scrape type for 1980271: 1
2026-03-24 22:50:07 [ayvens.be] INFO: Extracting data for car ID: 1980271
2026-03-24 22:50:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1980271
2026-03-24 22:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe589cd-55eb-56c1-a18a-eb475b284f11 with scrape type 1
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/1.jpg not downloaded yet
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cfc90>
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/6.jpg saved to cache
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ecdd0>
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/7.jpg saved to cache
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/2.jpg not downloaded yet
2026-03-24 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/3.jpg not downloaded yet
2026-03-24 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/4.jpg not downloaded yet
2026-03-24 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/5.jpg not downloaded yet
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/6.jpg not downloaded yet
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/7.jpg not downloaded yet
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc4550>
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/10.jpg saved to cache
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ab350>
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/5.jpg saved to cache
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/8.jpg not downloaded yet
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a6e10>
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/3.jpg saved to cache
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/9.jpg not downloaded yet
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/10.jpg not downloaded yet
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cda750>
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/9.jpg saved to cache
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095aa890>
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F0e2ab1eab4a94de7b65fca04d8129a53%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/8.jpg saved to cache
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e
2026-03-24 22:50:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 199ab21c-1cd9-5623-98ea-15f33b9eca6e, skipping ID generation
2026-03-24 22:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e with scrape type 1
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e sending to next pipeline
2026-03-24 22:50:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 199ab21c-1cd9-5623-98ea-15f33b9eca6e, identifier: 1980269
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914d010>
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/1.jpg saved to cache
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008381890>
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/2.jpg saved to cache
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094709d0>
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/4.jpg saved to cache
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 199ab21c-1cd9-5623-98ea-15f33b9eca6e with identifier: 1980269
2026-03-24 22:50:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 199ab21c-1cd9-5623-98ea-15f33b9eca6e with identifier: 1980269
2026-03-24 22:50:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 199ab21c-1cd9-5623-98ea-15f33b9eca6e with identifier: 1980269 to the API
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '199ab21c-1cd9-5623-98ea-15f33b9eca6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE COUPAu2030',
 'odometer': 127414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_199ab21c-1cd9-5623-98ea-15f33b9eca6e/199ab21c-1cd9-5623-98ea-15f33b9eca6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/0e2ab1eab4a94de7b65fca04d8129a53/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE COUPAu2030 2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980269%27 HTTP/1.1" 200 None
2026-03-24 22:50:08 [ayvens.be] INFO: Saving data for 1980269: {'created_time': 1774392608.955247, 'last_price_update_time': 1774392608.955257, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980269') HTTP/1.1" 204 0
2026-03-24 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:08 [ayvens.be] INFO: Found listing with ID: 1980272
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980272%27 HTTP/1.1" 200 None
2026-03-24 22:50:08 [ayvens.be] INFO: Scrape type for 1980272: 1
2026-03-24 22:50:08 [ayvens.be] INFO: Extracting data for car ID: 1980272
2026-03-24 22:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9155e206-88ff-5b8a-9de4-bc24e1c42175 with identifier: 1980272
2026-03-24 22:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9155e206-88ff-5b8a-9de4-bc24e1c42175 with scrape type 1
2026-03-24 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/1.jpg not downloaded yet
2026-03-24 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/2.jpg not downloaded yet
2026-03-24 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/3.jpg not downloaded yet
2026-03-24 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009793fd0>
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/6.jpg saved to cache
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/4.jpg not downloaded yet
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/5.jpg not downloaded yet
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/6.jpg not downloaded yet
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009612090>
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/5.jpg saved to cache
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8410>
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/9.jpg saved to cache
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3490>
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/10.jpg saved to cache
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971af10>
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/7.jpg saved to cache
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/7.jpg not downloaded yet
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c09d0>
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Ffe706613059748ee89443d7d8b0ed971%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/8.jpg saved to cache
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14
2026-03-24 22:50:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddafa458-3cf3-57c1-abb3-73f34a7dfa14, skipping ID generation
2026-03-24 22:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with scrape type 1
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14 sending to next pipeline
2026-03-24 22:50:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ddafa458-3cf3-57c1-abb3-73f34a7dfa14, identifier: 1980270
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7dd0>
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/1.jpg saved to cache
2026-03-24 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1980270
2026-03-24 22:50:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1980270
2026-03-24 22:50:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1980270 to the API
2026-03-24 22:50:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ddafa458-3cf3-57c1-abb3-73f34a7dfa14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 85430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddafa458-3cf3-57c1-abb3-73f34a7dfa14/ddafa458-3cf3-57c1-abb3-73f34a7dfa14_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/fe706613059748ee89443d7d8b0ed971/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980270%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [ayvens.be] INFO: Saving data for 1980270: {'created_time': 1774392610.194344, 'last_price_update_time': 1774392610.194354, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980270') HTTP/1.1" 204 0
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/8.jpg not downloaded yet
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ccf50>
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/2.jpg saved to cache
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/9.jpg not downloaded yet
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/10.jpg not downloaded yet
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [ayvens.be] INFO: Found listing with ID: 1980273
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980273%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [ayvens.be] INFO: Scrape type for 1980273: 1
2026-03-24 22:50:10 [ayvens.be] INFO: Extracting data for car ID: 1980273
2026-03-24 22:50:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1980273
2026-03-24 22:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with scrape type 1
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/1.jpg not downloaded yet
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/2.jpg not downloaded yet
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834f390>
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/7.jpg saved to cache
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/3.jpg not downloaded yet
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/4.jpg not downloaded yet
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a12d0>
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/8.jpg saved to cache
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce410>
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/6.jpg saved to cache
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/5.jpg not downloaded yet
2026-03-24 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a3f50>
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/3.jpg saved to cache
2026-03-24 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009762f50>
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/5.jpg saved to cache
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/6.jpg not downloaded yet
2026-03-24 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938fa50>
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/4.jpg saved to cache
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564a90>
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/1.jpg saved to cache
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b63d10>
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/9.jpg saved to cache
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009940f50>
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F9e788ab500c24c79bb9a86bfeb9298e4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/10.jpg saved to cache
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fe589cd-55eb-56c1-a18a-eb475b284f11
2026-03-24 22:50:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fe589cd-55eb-56c1-a18a-eb475b284f11, skipping ID generation
2026-03-24 22:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe589cd-55eb-56c1-a18a-eb475b284f11 with scrape type 1
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fe589cd-55eb-56c1-a18a-eb475b284f11 sending to next pipeline
2026-03-24 22:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fe589cd-55eb-56c1-a18a-eb475b284f11, identifier: 1980271
2026-03-24 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/7.jpg not downloaded yet
2026-03-24 22:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1980271
2026-03-24 22:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1980271
2026-03-24 22:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1980271 to the API
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8fe589cd-55eb-56c1-a18a-eb475b284f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 135693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 963842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe589cd-55eb-56c1-a18a-eb475b284f11/8fe589cd-55eb-56c1-a18a-eb475b284f11_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 923287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/9e788ab500c24c79bb9a86bfeb9298e4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980271%27 HTTP/1.1" 200 None
2026-03-24 22:50:11 [ayvens.be] INFO: Saving data for 1980271: {'created_time': 1774392611.92864, 'last_price_update_time': 1774392611.928657, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980271') HTTP/1.1" 204 0
2026-03-24 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00be08890>
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/2.jpg saved to cache
2026-03-24 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/8.jpg not downloaded yet
2026-03-24 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3110>
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/4.jpg saved to cache
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938de50>
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/3.jpg saved to cache
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ec510>
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/7.jpg saved to cache
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b3050>
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/8.jpg saved to cache
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369590>
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/9.jpg saved to cache
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/9.jpg not downloaded yet
2026-03-24 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/10.jpg not downloaded yet
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343990>
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/6.jpg saved to cache
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c0490>
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/5.jpg saved to cache
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938dd50>
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F232d5b1483d3403cac62f8fbd18e54e5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/10.jpg saved to cache
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9155e206-88ff-5b8a-9de4-bc24e1c42175
2026-03-24 22:50:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9155e206-88ff-5b8a-9de4-bc24e1c42175, skipping ID generation
2026-03-24 22:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9155e206-88ff-5b8a-9de4-bc24e1c42175 with scrape type 1
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9155e206-88ff-5b8a-9de4-bc24e1c42175 sending to next pipeline
2026-03-24 22:50:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9155e206-88ff-5b8a-9de4-bc24e1c42175, identifier: 1980272
2026-03-24 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:12 [ayvens.be] INFO: Found listing with ID: 1980274
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980274%27 HTTP/1.1" 200 None
2026-03-24 22:50:12 [ayvens.be] INFO: Scrape type for 1980274: 1
2026-03-24 22:50:12 [ayvens.be] INFO: Extracting data for car ID: 1980274
2026-03-24 22:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1980274
2026-03-24 22:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with scrape type 1
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/1.jpg not downloaded yet
2026-03-24 22:50:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9155e206-88ff-5b8a-9de4-bc24e1c42175 with identifier: 1980272
2026-03-24 22:50:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9155e206-88ff-5b8a-9de4-bc24e1c42175 with identifier: 1980272
2026-03-24 22:50:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9155e206-88ff-5b8a-9de4-bc24e1c42175 with identifier: 1980272 to the API
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '9155e206-88ff-5b8a-9de4-bc24e1c42175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 103561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9155e206-88ff-5b8a-9de4-bc24e1c42175/9155e206-88ff-5b8a-9de4-bc24e1c42175_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/232d5b1483d3403cac62f8fbd18e54e5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980272%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [ayvens.be] INFO: Saving data for 1980272: {'created_time': 1774392613.099271, 'last_price_update_time': 1774392613.099282, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980272') HTTP/1.1" 204 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/2.jpg not downloaded yet
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1550>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/5.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871890>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/4.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6850>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/1.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009490b90>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/2.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4fd0>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/3.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/3.jpg not downloaded yet
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/4.jpg not downloaded yet
2026-03-24 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/5.jpg not downloaded yet
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/6.jpg not downloaded yet
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/7.jpg not downloaded yet
2026-03-24 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/8.jpg not downloaded yet
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009397c10>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/7.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083718d0>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/8.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/9.jpg not downloaded yet
2026-03-24 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916ee90>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/6.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838f4d0>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/9.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/10.jpg not downloaded yet
2026-03-24 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb0b90>
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F1fbe6478f55648cca0bdbd79019c5471%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/10.jpg saved to cache
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c
2026-03-24 22:50:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c, skipping ID generation
2026-03-24 22:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with scrape type 1
2026-03-24 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c sending to next pipeline
2026-03-24 22:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c, identifier: 1980273
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871390>
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/1.jpg saved to cache
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:14 [ayvens.be] INFO: Found listing with ID: 1980275
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980275%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [ayvens.be] INFO: Scrape type for 1980275: 1
2026-03-24 22:50:14 [ayvens.be] INFO: Extracting data for car ID: 1980275
2026-03-24 22:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1980275
2026-03-24 22:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31776f69-743f-5210-afca-b1b6483e3e9e with scrape type 1
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/1.jpg not downloaded yet
2026-03-24 22:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1980273
2026-03-24 22:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1980273
2026-03-24 22:50:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1980273 to the API
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8a53da03-7f2a-5801-ba2a-6387e94f4c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 17867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a53da03-7f2a-5801-ba2a-6387e94f4c8c/8a53da03-7f2a-5801-ba2a-6387e94f4c8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/1fbe6478f55648cca0bdbd79019c5471/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 160 Business Solution',
 'transmission': 'manual',
 'trim': 'A 160 Business Solution',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980273%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [ayvens.be] INFO: Saving data for 1980273: {'created_time': 1774392614.377152, 'last_price_update_time': 1774392614.377162, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980273') HTTP/1.1" 204 0
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94dd0>
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/2.jpg saved to cache
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/2.jpg not downloaded yet
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4d50>
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/3.jpg saved to cache
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009185750>
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/4.jpg saved to cache
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091197d0>
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/5.jpg saved to cache
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911b7d0>
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/6.jpg saved to cache
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/3.jpg not downloaded yet
2026-03-24 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/4.jpg not downloaded yet
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008314f50>
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/7.jpg saved to cache
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/5.jpg not downloaded yet
2026-03-24 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/6.jpg not downloaded yet
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/7.jpg not downloaded yet
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/8.jpg not downloaded yet
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834fd50>
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/8.jpg saved to cache
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a5790>
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/9.jpg saved to cache
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/9.jpg not downloaded yet
2026-03-24 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/10.jpg not downloaded yet
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095edcd0>
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fbe25a0b25c5f4791adaa183823776443%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/10.jpg saved to cache
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77
2026-03-24 22:50:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77, skipping ID generation
2026-03-24 22:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with scrape type 1
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 sending to next pipeline
2026-03-24 22:50:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77, identifier: 1980274
2026-03-24 22:50:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1980274
2026-03-24 22:50:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1980274
2026-03-24 22:50:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1980274 to the API
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2 DIESEL',
 'odometer': 85006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77/9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/be25a0b25c5f4791adaa183823776443/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 DIESEL 1.5 dA sDrive16',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980274%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [ayvens.be] INFO: Saving data for 1980274: {'created_time': 1774392615.47338, 'last_price_update_time': 1774392615.473389, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980274') HTTP/1.1" 204 0
2026-03-24 22:50:15 [ayvens.be] INFO: Found listing with ID: 1980276
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980276%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [ayvens.be] INFO: Scrape type for 1980276: 1
2026-03-24 22:50:15 [ayvens.be] INFO: Extracting data for car ID: 1980276
2026-03-24 22:50:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1980276
2026-03-24 22:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d58cdd-aa50-5952-b531-46485dc8de9c with scrape type 1
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/1.jpg not downloaded yet
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406990>
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/1.jpg saved to cache
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/2.jpg not downloaded yet
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/3.jpg not downloaded yet
2026-03-24 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/4.jpg not downloaded yet
2026-03-24 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/5.jpg not downloaded yet
2026-03-24 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/6.jpg not downloaded yet
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/7.jpg not downloaded yet
2026-03-24 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/8.jpg not downloaded yet
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/9.jpg not downloaded yet
2026-03-24 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/10.jpg not downloaded yet
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095a9810>
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/3.jpg saved to cache
2026-03-24 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d5190>
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/4.jpg saved to cache
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:16 [ayvens.be] INFO: Found listing with ID: 1980277
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980277%27 HTTP/1.1" 200 None
2026-03-24 22:50:16 [ayvens.be] INFO: Scrape type for 1980277: 1
2026-03-24 22:50:16 [ayvens.be] INFO: Extracting data for car ID: 1980277
2026-03-24 22:50:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1980277
2026-03-24 22:50:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with scrape type 1
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/1.jpg not downloaded yet
2026-03-24 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009611d10>
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/5.jpg saved to cache
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009759bd0>
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/6.jpg saved to cache
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/2.jpg not downloaded yet
2026-03-24 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/3.jpg not downloaded yet
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083715d0>
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/2.jpg saved to cache
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938e010>
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/7.jpg saved to cache
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d9310>
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/8.jpg saved to cache
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009176810>
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/9.jpg saved to cache
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b5f10>
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/3.jpg saved to cache
2026-03-24 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098739d0>
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/1.jpg saved to cache
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdb490>
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/5.jpg saved to cache
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/4.jpg not downloaded yet
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009129c90>
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/4.jpg saved to cache
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b1850>
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/2.jpg saved to cache
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128cd0>
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/6.jpg saved to cache
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/5.jpg not downloaded yet
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/6.jpg not downloaded yet
2026-03-24 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/7.jpg not downloaded yet
2026-03-24 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/8.jpg not downloaded yet
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/9.jpg not downloaded yet
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/10.jpg not downloaded yet
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aa010>
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fcb82089728dc45fdbc515e42f4b3c399%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/10.jpg saved to cache
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31776f69-743f-5210-afca-b1b6483e3e9e
2026-03-24 22:50:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31776f69-743f-5210-afca-b1b6483e3e9e, skipping ID generation
2026-03-24 22:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31776f69-743f-5210-afca-b1b6483e3e9e with scrape type 1
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31776f69-743f-5210-afca-b1b6483e3e9e sending to next pipeline
2026-03-24 22:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 31776f69-743f-5210-afca-b1b6483e3e9e, identifier: 1980275
2026-03-24 22:50:17 [ayvens.be] INFO: Found listing with ID: 1980278
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980278%27 HTTP/1.1" 200 None
2026-03-24 22:50:17 [ayvens.be] INFO: Scrape type for 1980278: 1
2026-03-24 22:50:17 [ayvens.be] INFO: Extracting data for car ID: 1980278
2026-03-24 22:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12b266b9-7e3d-5de4-b274-228f59a3255d with identifier: 1980278
2026-03-24 22:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12b266b9-7e3d-5de4-b274-228f59a3255d with scrape type 1
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/1.jpg not downloaded yet
2026-03-24 22:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1980275
2026-03-24 22:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1980275
2026-03-24 22:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1980275 to the API
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '31776f69-743f-5210-afca-b1b6483e3e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 140122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31776f69-743f-5210-afca-b1b6483e3e9e/31776f69-743f-5210-afca-b1b6483e3e9e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/cb82089728dc45fdbc515e42f4b3c399/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980275%27 HTTP/1.1" 200 None
2026-03-24 22:50:18 [ayvens.be] INFO: Saving data for 1980275: {'created_time': 1774392618.077407, 'last_price_update_time': 1774392618.077417, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980275') HTTP/1.1" 204 0
2026-03-24 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/2.jpg not downloaded yet
2026-03-24 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2410>
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/1.jpg saved to cache
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083877d0>
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/2.jpg saved to cache
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938e390>
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/10.jpg saved to cache
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963ae90>
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/9.jpg saved to cache
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913fe90>
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/7.jpg saved to cache
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873750>
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F5ead487aafbe48ca9a86f21b719cd567%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/8.jpg saved to cache
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6d58cdd-aa50-5952-b531-46485dc8de9c
2026-03-24 22:50:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6d58cdd-aa50-5952-b531-46485dc8de9c, skipping ID generation
2026-03-24 22:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d58cdd-aa50-5952-b531-46485dc8de9c with scrape type 1
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6d58cdd-aa50-5952-b531-46485dc8de9c sending to next pipeline
2026-03-24 22:50:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6d58cdd-aa50-5952-b531-46485dc8de9c, identifier: 1980276
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/3.jpg not downloaded yet
2026-03-24 22:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1980276
2026-03-24 22:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1980276
2026-03-24 22:50:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1980276 to the API
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b6d58cdd-aa50-5952-b531-46485dc8de9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d58cdd-aa50-5952-b531-46485dc8de9c/b6d58cdd-aa50-5952-b531-46485dc8de9c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/5ead487aafbe48ca9a86f21b719cd567/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980276%27 HTTP/1.1" 200 None
2026-03-24 22:50:19 [ayvens.be] INFO: Saving data for 1980276: {'created_time': 1774392619.029101, 'last_price_update_time': 1774392619.029111, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980276') HTTP/1.1" 204 0
2026-03-24 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/4.jpg not downloaded yet
2026-03-24 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009132c90>
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/3.jpg saved to cache
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013250>
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/5.jpg saved to cache
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00986a350>
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/4.jpg saved to cache
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/5.jpg not downloaded yet
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/6.jpg not downloaded yet
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c79d0>
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/6.jpg saved to cache
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372a10>
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/8.jpg saved to cache
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009130b10>
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/7.jpg saved to cache
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009629410>
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/9.jpg saved to cache
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/7.jpg not downloaded yet
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/8.jpg not downloaded yet
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d00a10>
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F8e91fbb877c145729bc1cbf0adf285b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/10.jpg saved to cache
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2
2026-03-24 22:50:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00efd6d5-bab1-54f3-8526-5077d1dd40f2, skipping ID generation
2026-03-24 22:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with scrape type 1
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2 sending to next pipeline
2026-03-24 22:50:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00efd6d5-bab1-54f3-8526-5077d1dd40f2, identifier: 1980277
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/9.jpg not downloaded yet
2026-03-24 22:50:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1980277
2026-03-24 22:50:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1980277
2026-03-24 22:50:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1980277 to the API
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '00efd6d5-bab1-54f3-8526-5077d1dd40f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 78888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00efd6d5-bab1-54f3-8526-5077d1dd40f2/00efd6d5-bab1-54f3-8526-5077d1dd40f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/8e91fbb877c145729bc1cbf0adf285b9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2.0TDCI 96KW TREND 350L',
 'transmission': 'manual',
 'trim': '2.0TDCI 96KW TREND 350L',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980277%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [ayvens.be] INFO: Saving data for 1980277: {'created_time': 1774392620.297853, 'last_price_update_time': 1774392620.297862, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980277') HTTP/1.1" 204 0
2026-03-24 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/10.jpg not downloaded yet
2026-03-24 22:50:20 [ayvens.be] INFO: Found listing with ID: 1980279
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980279%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [ayvens.be] INFO: Scrape type for 1980279: 1
2026-03-24 22:50:20 [ayvens.be] INFO: Extracting data for car ID: 1980279
2026-03-24 22:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1980279
2026-03-24 22:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313dd6d5-92c8-50d8-8204-aa92b87058e7 with scrape type 1
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/1.jpg not downloaded yet
2026-03-24 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/2.jpg not downloaded yet
2026-03-24 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/3.jpg not downloaded yet
2026-03-24 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/4.jpg not downloaded yet
2026-03-24 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/5.jpg not downloaded yet
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1a50>
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/1.jpg saved to cache
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/6.jpg not downloaded yet
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/7.jpg not downloaded yet
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4d50>
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/3.jpg saved to cache
2026-03-24 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978a250>
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/2.jpg saved to cache
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bce50>
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/4.jpg saved to cache
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1bb050>
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/5.jpg saved to cache
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913d190>
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/6.jpg saved to cache
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bcb90>
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/7.jpg saved to cache
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/8.jpg not downloaded yet
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/9.jpg not downloaded yet
2026-03-24 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/10.jpg not downloaded yet
2026-03-24 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:21 [ayvens.be] INFO: Found listing with ID: 1980280
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980280%27 HTTP/1.1" 200 None
2026-03-24 22:50:21 [ayvens.be] INFO: Scrape type for 1980280: 1
2026-03-24 22:50:21 [ayvens.be] INFO: Extracting data for car ID: 1980280
2026-03-24 22:50:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d16051d6-c829-5f14-947a-90fd03d73757 with identifier: 1980280
2026-03-24 22:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d16051d6-c829-5f14-947a-90fd03d73757 with scrape type 1
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/1.jpg not downloaded yet
2026-03-24 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/2.jpg not downloaded yet
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345bd0>
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/9.jpg saved to cache
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/3.jpg not downloaded yet
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/4.jpg not downloaded yet
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083691d0>
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/8.jpg saved to cache
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009839250>
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fd81bd377ebc04d8ab347ed6e6109d81f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/10.jpg saved to cache
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12b266b9-7e3d-5de4-b274-228f59a3255d
2026-03-24 22:50:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12b266b9-7e3d-5de4-b274-228f59a3255d, skipping ID generation
2026-03-24 22:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12b266b9-7e3d-5de4-b274-228f59a3255d with scrape type 1
2026-03-24 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12b266b9-7e3d-5de4-b274-228f59a3255d sending to next pipeline
2026-03-24 22:50:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 12b266b9-7e3d-5de4-b274-228f59a3255d, identifier: 1980278
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008339fd0>
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/1.jpg saved to cache
2026-03-24 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008371e10>
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/3.jpg saved to cache
2026-03-24 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 12b266b9-7e3d-5de4-b274-228f59a3255d with identifier: 1980278
2026-03-24 22:50:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 12b266b9-7e3d-5de4-b274-228f59a3255d with identifier: 1980278
2026-03-24 22:50:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 12b266b9-7e3d-5de4-b274-228f59a3255d with identifier: 1980278 to the API
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '12b266b9-7e3d-5de4-b274-228f59a3255d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 199248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12b266b9-7e3d-5de4-b274-228f59a3255d/12b266b9-7e3d-5de4-b274-228f59a3255d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/d81bd377ebc04d8ab347ed6e6109d81f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980278%27 HTTP/1.1" 200 None
2026-03-24 22:50:22 [ayvens.be] INFO: Saving data for 1980278: {'created_time': 1774392622.536759, 'last_price_update_time': 1774392622.536767, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980278') HTTP/1.1" 204 0
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/5.jpg not downloaded yet
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098732d0>
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/2.jpg saved to cache
2026-03-24 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1dfa10>
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/5.jpg saved to cache
2026-03-24 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871450>
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/4.jpg saved to cache
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/6.jpg not downloaded yet
2026-03-24 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/7.jpg not downloaded yet
2026-03-24 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/8.jpg not downloaded yet
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/9.jpg not downloaded yet
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/10.jpg not downloaded yet
2026-03-24 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:23 [ayvens.be] INFO: Found listing with ID: 1980281
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980281%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [ayvens.be] INFO: Scrape type for 1980281: 1
2026-03-24 22:50:23 [ayvens.be] INFO: Extracting data for car ID: 1980281
2026-03-24 22:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8009b226-ed8e-5f06-88fd-1423f9addacc with identifier: 1980281
2026-03-24 22:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8009b226-ed8e-5f06-88fd-1423f9addacc with scrape type 1
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/1.jpg not downloaded yet
2026-03-24 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/2.jpg not downloaded yet
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/3.jpg not downloaded yet
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871550>
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/9.jpg saved to cache
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/4.jpg not downloaded yet
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4650>
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/7.jpg saved to cache
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910c6d0>
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/6.jpg saved to cache
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3950>
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/10.jpg saved to cache
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bcdd0>
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F24ee9db6772942bcaca8e01e96875e3c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/8.jpg saved to cache
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 313dd6d5-92c8-50d8-8204-aa92b87058e7
2026-03-24 22:50:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 313dd6d5-92c8-50d8-8204-aa92b87058e7, skipping ID generation
2026-03-24 22:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313dd6d5-92c8-50d8-8204-aa92b87058e7 with scrape type 1
2026-03-24 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 313dd6d5-92c8-50d8-8204-aa92b87058e7 sending to next pipeline
2026-03-24 22:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 313dd6d5-92c8-50d8-8204-aa92b87058e7, identifier: 1980279
2026-03-24 22:50:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1980279
2026-03-24 22:50:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1980279
2026-03-24 22:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1980279 to the API
2026-03-24 22:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '313dd6d5-92c8-50d8-8204-aa92b87058e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 63230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313dd6d5-92c8-50d8-8204-aa92b87058e7/313dd6d5-92c8-50d8-8204-aa92b87058e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/24ee9db6772942bcaca8e01e96875e3c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA 64 KWH ELECTRIC SKY',
 'transmission': 'automatic',
 'trim': '64 KWH ELECTRIC SKY',
 'vin': None,
 'year': 2020}
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980279%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [ayvens.be] INFO: Saving data for 1980279: {'created_time': 1774392624.16806, 'last_price_update_time': 1774392624.168069, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980279') HTTP/1.1" 204 0
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/5.jpg not downloaded yet
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009471610>
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/1.jpg saved to cache
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008315350>
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/3.jpg saved to cache
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761890>
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/2.jpg saved to cache
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/6.jpg not downloaded yet
2026-03-24 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/7.jpg not downloaded yet
2026-03-24 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/8.jpg not downloaded yet
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/9.jpg not downloaded yet
2026-03-24 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/10.jpg not downloaded yet
2026-03-24 22:50:24 [ayvens.be] INFO: Found listing with ID: 1980282
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980282%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [ayvens.be] INFO: Scrape type for 1980282: 1
2026-03-24 22:50:24 [ayvens.be] INFO: Extracting data for car ID: 1980282
2026-03-24 22:50:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1980282
2026-03-24 22:50:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98af7d6-f024-5aa3-97ef-40e680410d5e with scrape type 1
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/1.jpg not downloaded yet
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/2.jpg not downloaded yet
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760b90>
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/7.jpg saved to cache
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830bc10>
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/4.jpg saved to cache
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/3.jpg not downloaded yet
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf6250>
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/6.jpg saved to cache
2026-03-24 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1690>
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/5.jpg saved to cache
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/4.jpg not downloaded yet
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a450>
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/8.jpg saved to cache
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cdb50>
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/10.jpg saved to cache
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b619d0>
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F0d2d4a0b403f4809a1b4f292c9a1b2bd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/9.jpg saved to cache
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d16051d6-c829-5f14-947a-90fd03d73757
2026-03-24 22:50:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d16051d6-c829-5f14-947a-90fd03d73757, skipping ID generation
2026-03-24 22:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d16051d6-c829-5f14-947a-90fd03d73757 with scrape type 1
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d16051d6-c829-5f14-947a-90fd03d73757 sending to next pipeline
2026-03-24 22:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d16051d6-c829-5f14-947a-90fd03d73757, identifier: 1980280
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/5.jpg not downloaded yet
2026-03-24 22:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d16051d6-c829-5f14-947a-90fd03d73757 with identifier: 1980280
2026-03-24 22:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d16051d6-c829-5f14-947a-90fd03d73757 with identifier: 1980280
2026-03-24 22:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d16051d6-c829-5f14-947a-90fd03d73757 with identifier: 1980280 to the API
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd16051d6-c829-5f14-947a-90fd03d73757',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 101395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d16051d6-c829-5f14-947a-90fd03d73757/d16051d6-c829-5f14-947a-90fd03d73757_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/0d2d4a0b403f4809a1b4f292c9a1b2bd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PURETECH 96KW S-S ALLURE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S ALLURE',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980280%27 HTTP/1.1" 200 None
2026-03-24 22:50:25 [ayvens.be] INFO: Saving data for 1980280: {'created_time': 1774392625.85694, 'last_price_update_time': 1774392625.856952, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980280') HTTP/1.1" 204 0
2026-03-24 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/6.jpg not downloaded yet
2026-03-24 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/7.jpg not downloaded yet
2026-03-24 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/8.jpg not downloaded yet
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/9.jpg not downloaded yet
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/10.jpg not downloaded yet
2026-03-24 22:50:25 [ayvens.be] INFO: Found listing with ID: 1980283
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980283%27 HTTP/1.1" 200 None
2026-03-24 22:50:25 [ayvens.be] INFO: Scrape type for 1980283: 1
2026-03-24 22:50:25 [ayvens.be] INFO: Extracting data for car ID: 1980283
2026-03-24 22:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6d868b1-3833-5891-888d-2c7a0bcc8d68 with identifier: 1980283
2026-03-24 22:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6d868b1-3833-5891-888d-2c7a0bcc8d68 with scrape type 1
2026-03-24 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/1.jpg not downloaded yet
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/2.jpg not downloaded yet
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095a9d50>
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/4.jpg saved to cache
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641ed0>
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/5.jpg saved to cache
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422050>
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/3.jpg saved to cache
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009614dd0>
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/1.jpg saved to cache
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009174650>
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/2.jpg saved to cache
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175150>
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/6.jpg saved to cache
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/3.jpg not downloaded yet
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3dd0>
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/7.jpg saved to cache
2026-03-24 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1350>
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/3.jpg saved to cache
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/4.jpg not downloaded yet
2026-03-24 22:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464e10>
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/2.jpg saved to cache
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/5.jpg not downloaded yet
2026-03-24 22:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/6.jpg not downloaded yet
2026-03-24 22:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/7.jpg not downloaded yet
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0390>
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/4.jpg saved to cache
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009640890>
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/6.jpg saved to cache
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/8.jpg not downloaded yet
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/9.jpg not downloaded yet
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bff90>
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/1.jpg saved to cache
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009146290>
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/5.jpg saved to cache
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7510>
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/10.jpg saved to cache
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b7d0>
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/9.jpg saved to cache
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e0d50>
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F3956098a87574b2a907716e72b308ad7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/8.jpg saved to cache
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8009b226-ed8e-5f06-88fd-1423f9addacc
2026-03-24 22:50:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8009b226-ed8e-5f06-88fd-1423f9addacc, skipping ID generation
2026-03-24 22:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8009b226-ed8e-5f06-88fd-1423f9addacc with scrape type 1
2026-03-24 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8009b226-ed8e-5f06-88fd-1423f9addacc sending to next pipeline
2026-03-24 22:50:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8009b226-ed8e-5f06-88fd-1423f9addacc, identifier: 1980281
2026-03-24 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/10.jpg not downloaded yet
2026-03-24 22:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8009b226-ed8e-5f06-88fd-1423f9addacc with identifier: 1980281
2026-03-24 22:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8009b226-ed8e-5f06-88fd-1423f9addacc with identifier: 1980281
2026-03-24 22:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8009b226-ed8e-5f06-88fd-1423f9addacc with identifier: 1980281 to the API
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8009b226-ed8e-5f06-88fd-1423f9addacc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 176568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8009b226-ed8e-5f06-88fd-1423f9addacc/8009b226-ed8e-5f06-88fd-1423f9addacc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/3956098a87574b2a907716e72b308ad7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980281%27 HTTP/1.1" 200 None
2026-03-24 22:50:28 [ayvens.be] INFO: Saving data for 1980281: {'created_time': 1774392628.337876, 'last_price_update_time': 1774392628.337885, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980281') HTTP/1.1" 204 0
2026-03-24 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:28 [ayvens.be] INFO: Found listing with ID: 1980284
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980284%27 HTTP/1.1" 200 None
2026-03-24 22:50:28 [ayvens.be] INFO: Scrape type for 1980284: 1
2026-03-24 22:50:28 [ayvens.be] INFO: Extracting data for car ID: 1980284
2026-03-24 22:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72602aec-d0d8-576b-b164-e468add0d3bc with identifier: 1980284
2026-03-24 22:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72602aec-d0d8-576b-b164-e468add0d3bc with scrape type 1
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/1.jpg not downloaded yet
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/2.jpg not downloaded yet
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096dcb10>
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/9.jpg saved to cache
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839b7d0>
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/10.jpg saved to cache
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b96d0>
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/8.jpg saved to cache
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/3.jpg not downloaded yet
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/4.jpg not downloaded yet
2026-03-24 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a4d90>
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F61eea56de09541f7b4798638eed1bf38%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/7.jpg saved to cache
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b98af7d6-f024-5aa3-97ef-40e680410d5e
2026-03-24 22:50:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b98af7d6-f024-5aa3-97ef-40e680410d5e, skipping ID generation
2026-03-24 22:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98af7d6-f024-5aa3-97ef-40e680410d5e with scrape type 1
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b98af7d6-f024-5aa3-97ef-40e680410d5e sending to next pipeline
2026-03-24 22:50:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b98af7d6-f024-5aa3-97ef-40e680410d5e, identifier: 1980282
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/5.jpg not downloaded yet
2026-03-24 22:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1980282
2026-03-24 22:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1980282
2026-03-24 22:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1980282 to the API
2026-03-24 22:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b98af7d6-f024-5aa3-97ef-40e680410d5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 40473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b98af7d6-f024-5aa3-97ef-40e680410d5e/b98af7d6-f024-5aa3-97ef-40e680410d5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/61eea56de09541f7b4798638eed1bf38/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980282%27 HTTP/1.1" 200 None
2026-03-24 22:50:29 [ayvens.be] INFO: Saving data for 1980282: {'created_time': 1774392629.16545, 'last_price_update_time': 1774392629.165459, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980282') HTTP/1.1" 204 0
2026-03-24 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/6.jpg not downloaded yet
2026-03-24 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098397d0>
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/2.jpg saved to cache
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab810>
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/1.jpg saved to cache
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910ded0>
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/3.jpg saved to cache
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/7.jpg not downloaded yet
2026-03-24 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/8.jpg not downloaded yet
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8e90>
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/4.jpg saved to cache
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492e10>
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/6.jpg saved to cache
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/9.jpg not downloaded yet
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/10.jpg not downloaded yet
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915c6d0>
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/7.jpg saved to cache
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c310>
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/5.jpg saved to cache
2026-03-24 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009686f90>
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/8.jpg saved to cache
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:30 [ayvens.be] INFO: Found listing with ID: 1980285
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980285%27 HTTP/1.1" 200 None
2026-03-24 22:50:30 [ayvens.be] INFO: Scrape type for 1980285: 1
2026-03-24 22:50:30 [ayvens.be] INFO: Extracting data for car ID: 1980285
2026-03-24 22:50:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1980285
2026-03-24 22:50:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with scrape type 1
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/1.jpg not downloaded yet
2026-03-24 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/2.jpg not downloaded yet
2026-03-24 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964c250>
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/9.jpg saved to cache
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008316b10>
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F28176079a526462199e907dd71ebf682%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/10.jpg saved to cache
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6d868b1-3833-5891-888d-2c7a0bcc8d68
2026-03-24 22:50:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6d868b1-3833-5891-888d-2c7a0bcc8d68, skipping ID generation
2026-03-24 22:50:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6d868b1-3833-5891-888d-2c7a0bcc8d68 with scrape type 1
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6d868b1-3833-5891-888d-2c7a0bcc8d68 sending to next pipeline
2026-03-24 22:50:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c6d868b1-3833-5891-888d-2c7a0bcc8d68, identifier: 1980283
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/3.jpg not downloaded yet
2026-03-24 22:50:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c6d868b1-3833-5891-888d-2c7a0bcc8d68 with identifier: 1980283
2026-03-24 22:50:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c6d868b1-3833-5891-888d-2c7a0bcc8d68 with identifier: 1980283
2026-03-24 22:50:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c6d868b1-3833-5891-888d-2c7a0bcc8d68 with identifier: 1980283 to the API
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'c6d868b1-3833-5891-888d-2c7a0bcc8d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 59250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d868b1-3833-5891-888d-2c7a0bcc8d68/c6d868b1-3833-5891-888d-2c7a0bcc8d68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/28176079a526462199e907dd71ebf682/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 70KWH RECHARGE ULTIMATE',
 'transmission': 'automatic',
 'trim': 'BEV 70KWH RECHARGE ULTIMATE',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980283%27 HTTP/1.1" 200 None
2026-03-24 22:50:30 [ayvens.be] INFO: Saving data for 1980283: {'created_time': 1774392630.665509, 'last_price_update_time': 1774392630.665518, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980283') HTTP/1.1" 204 0
2026-03-24 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/4.jpg not downloaded yet
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493d90>
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/1.jpg saved to cache
2026-03-24 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d00f50>
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/4.jpg saved to cache
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009146490>
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/5.jpg saved to cache
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009008850>
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/2.jpg saved to cache
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917f590>
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/3.jpg saved to cache
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/5.jpg not downloaded yet
2026-03-24 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0710>
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/6.jpg saved to cache
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/6.jpg not downloaded yet
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6610>
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/8.jpg saved to cache
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/7.jpg not downloaded yet
2026-03-24 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/8.jpg not downloaded yet
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008308d10>
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/7.jpg saved to cache
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bd190>
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/9.jpg saved to cache
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638b50>
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F2e33b7bf72f04872bd10339158a2d22c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/10.jpg saved to cache
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72602aec-d0d8-576b-b164-e468add0d3bc
2026-03-24 22:50:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72602aec-d0d8-576b-b164-e468add0d3bc, skipping ID generation
2026-03-24 22:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72602aec-d0d8-576b-b164-e468add0d3bc with scrape type 1
2026-03-24 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72602aec-d0d8-576b-b164-e468add0d3bc sending to next pipeline
2026-03-24 22:50:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 72602aec-d0d8-576b-b164-e468add0d3bc, identifier: 1980284
2026-03-24 22:50:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 72602aec-d0d8-576b-b164-e468add0d3bc with identifier: 1980284
2026-03-24 22:50:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 72602aec-d0d8-576b-b164-e468add0d3bc with identifier: 1980284
2026-03-24 22:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 72602aec-d0d8-576b-b164-e468add0d3bc with identifier: 1980284 to the API
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '72602aec-d0d8-576b-b164-e468add0d3bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 57078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72602aec-d0d8-576b-b164-e468add0d3bc/72602aec-d0d8-576b-b164-e468add0d3bc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/2e33b7bf72f04872bd10339158a2d22c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980284%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [ayvens.be] INFO: Saving data for 1980284: {'created_time': 1774392632.207865, 'last_price_update_time': 1774392632.207875, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980284') HTTP/1.1" 204 0
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/9.jpg not downloaded yet
2026-03-24 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb0590>
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/1.jpg saved to cache
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/10.jpg not downloaded yet
2026-03-24 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:32 [ayvens.be] INFO: Found listing with ID: 1980286
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980286%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [ayvens.be] INFO: Scrape type for 1980286: 1
2026-03-24 22:50:32 [ayvens.be] INFO: Extracting data for car ID: 1980286
2026-03-24 22:50:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1980286
2026-03-24 22:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with scrape type 1
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/1.jpg not downloaded yet
2026-03-24 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/2.jpg not downloaded yet
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097601d0>
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/2.jpg saved to cache
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cf950>
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/3.jpg saved to cache
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/3.jpg not downloaded yet
2026-03-24 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/4.jpg not downloaded yet
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bfa10>
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/5.jpg saved to cache
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2010>
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/4.jpg saved to cache
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643110>
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/6.jpg saved to cache
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/5.jpg not downloaded yet
2026-03-24 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008398b10>
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/7.jpg saved to cache
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/6.jpg not downloaded yet
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/7.jpg not downloaded yet
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/8.jpg not downloaded yet
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963bf90>
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/8.jpg saved to cache
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/9.jpg not downloaded yet
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/10.jpg not downloaded yet
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009773390>
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/10.jpg saved to cache
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb3ed0>
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fdd82c591a4d24e698134196381a940c1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/9.jpg saved to cache
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9
2026-03-24 22:50:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9, skipping ID generation
2026-03-24 22:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with scrape type 1
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 sending to next pipeline
2026-03-24 22:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9, identifier: 1980285
2026-03-24 22:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1980285
2026-03-24 22:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1980285
2026-03-24 22:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1980285 to the API
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'e4341abc-d20c-5dc4-9c41-96d7b9c25bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 148807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4341abc-d20c-5dc4-9c41-96d7b9c25bd9/e4341abc-d20c-5dc4-9c41-96d7b9c25bd9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/dd82c591a4d24e698134196381a940c1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 71KWH EQA 250+ AMG LINE',
 'transmission': 'automatic',
 'trim': 'BEV 71KWH EQA 250+ AMG LINE',
 'vin': None,
 'year': 2023}
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980285%27 HTTP/1.1" 200 None
2026-03-24 22:50:33 [ayvens.be] INFO: Saving data for 1980285: {'created_time': 1774392633.709944, 'last_price_update_time': 1774392633.709955, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980285') HTTP/1.1" 204 0
2026-03-24 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:33 [ayvens.be] INFO: Found listing with ID: 1980287
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980287%27 HTTP/1.1" 200 None
2026-03-24 22:50:33 [ayvens.be] INFO: Scrape type for 1980287: 1
2026-03-24 22:50:33 [ayvens.be] INFO: Extracting data for car ID: 1980287
2026-03-24 22:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1980287
2026-03-24 22:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b with scrape type 1
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/1.jpg not downloaded yet
2026-03-24 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdafd0>
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/2.jpg saved to cache
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/2.jpg not downloaded yet
2026-03-24 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/3.jpg not downloaded yet
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3850>
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/1.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009184dd0>
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/6.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008384790>
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/5.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/4.jpg not downloaded yet
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d31d0>
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/4.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b4090>
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/3.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/5.jpg not downloaded yet
2026-03-24 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/6.jpg not downloaded yet
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009758810>
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/8.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a2450>
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/7.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/7.jpg not downloaded yet
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/8.jpg not downloaded yet
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838b90>
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/9.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638690>
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/1.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910f1d0>
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa7be177187cb454db46095e4a40d70b2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/10.jpg saved to cache
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b
2026-03-24 22:50:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b, skipping ID generation
2026-03-24 22:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with scrape type 1
2026-03-24 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b sending to next pipeline
2026-03-24 22:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b, identifier: 1980286
2026-03-24 22:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1980286
2026-03-24 22:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1980286
2026-03-24 22:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1980286 to the API
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e4bf4fcc-1696-5beb-b3eb-da3894a8b24b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 137222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4bf4fcc-1696-5beb-b3eb-da3894a8b24b/e4bf4fcc-1696-5beb-b3eb-da3894a8b24b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a7be177187cb454db46095e4a40d70b2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.6 PHEV 225 E-AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980286%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [ayvens.be] INFO: Saving data for 1980286: {'created_time': 1774392635.25646, 'last_price_update_time': 1774392635.256471, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980286') HTTP/1.1" 204 0
2026-03-24 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/9.jpg not downloaded yet
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175850>
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/2.jpg saved to cache
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/10.jpg not downloaded yet
2026-03-24 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:35 [ayvens.be] INFO: Found listing with ID: 1980288
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980288%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [ayvens.be] INFO: Scrape type for 1980288: 1
2026-03-24 22:50:35 [ayvens.be] INFO: Extracting data for car ID: 1980288
2026-03-24 22:50:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1980288
2026-03-24 22:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee1d7014-c475-5bb9-87c3-772c3e34a011 with scrape type 1
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/1.jpg not downloaded yet
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009421890>
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/4.jpg saved to cache
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009133190>
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/3.jpg saved to cache
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/2.jpg not downloaded yet
2026-03-24 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/3.jpg not downloaded yet
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871dd0>
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/6.jpg saved to cache
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cd9390>
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/5.jpg saved to cache
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/4.jpg not downloaded yet
2026-03-24 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/5.jpg not downloaded yet
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009176610>
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/7.jpg saved to cache
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/6.jpg not downloaded yet
2026-03-24 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/7.jpg not downloaded yet
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/8.jpg not downloaded yet
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2410>
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/8.jpg saved to cache
2026-03-24 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009465110>
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/9.jpg saved to cache
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/9.jpg not downloaded yet
2026-03-24 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/10.jpg not downloaded yet
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967db50>
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/1.jpg saved to cache
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772910>
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fd20f9b2674664fe4a7c517def4b8fe60%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/10.jpg saved to cache
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b
2026-03-24 22:50:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8b13729-051a-5f0f-82ed-76c5c3e0e89b, skipping ID generation
2026-03-24 22:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b with scrape type 1
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b sending to next pipeline
2026-03-24 22:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8b13729-051a-5f0f-82ed-76c5c3e0e89b, identifier: 1980287
2026-03-24 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1980287
2026-03-24 22:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1980287
2026-03-24 22:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1980287 to the API
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a8b13729-051a-5f0f-82ed-76c5c3e0e89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 50993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b13729-051a-5f0f-82ed-76c5c3e0e89b/a8b13729-051a-5f0f-82ed-76c5c3e0e89b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/d20f9b2674664fe4a7c517def4b8fe60/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving SchoolrnDouble Pedal',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving SchoolrnDouble Pedal',
 'vin': None,
 'year': 2023}
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980287%27 HTTP/1.1" 200 None
2026-03-24 22:50:36 [ayvens.be] INFO: Saving data for 1980287: {'created_time': 1774392636.583484, 'last_price_update_time': 1774392636.583493, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980287') HTTP/1.1" 204 0
2026-03-24 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:36 [ayvens.be] INFO: Found listing with ID: 1980289
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980289%27 HTTP/1.1" 200 None
2026-03-24 22:50:36 [ayvens.be] INFO: Scrape type for 1980289: 1
2026-03-24 22:50:36 [ayvens.be] INFO: Extracting data for car ID: 1980289
2026-03-24 22:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1980289
2026-03-24 22:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddc1730-e2f6-59ba-acb6-05479044fc6d with scrape type 1
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/1.jpg not downloaded yet
2026-03-24 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091332d0>
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/2.jpg saved to cache
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638910>
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/3.jpg saved to cache
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/2.jpg not downloaded yet
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018dd0>
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/4.jpg saved to cache
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/3.jpg not downloaded yet
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910cbd0>
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/6.jpg saved to cache
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a3ad0>
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/5.jpg saved to cache
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/4.jpg not downloaded yet
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/5.jpg not downloaded yet
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009642110>
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/8.jpg saved to cache
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422750>
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/7.jpg saved to cache
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94f90>
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/9.jpg saved to cache
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/6.jpg not downloaded yet
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/7.jpg not downloaded yet
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/8.jpg not downloaded yet
2026-03-24 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/9.jpg not downloaded yet
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/10.jpg not downloaded yet
2026-03-24 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:37 [ayvens.be] INFO: Found listing with ID: 1980290
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980290%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [ayvens.be] INFO: Scrape type for 1980290: 1
2026-03-24 22:50:37 [ayvens.be] INFO: Extracting data for car ID: 1980290
2026-03-24 22:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1980290
2026-03-24 22:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d88768-9bf6-5f29-90de-1b51ec377c95 with scrape type 1
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/1.jpg not downloaded yet
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/2.jpg not downloaded yet
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c0190>
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F4fd2024514234b52a0ade51159858024%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/10.jpg saved to cache
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee1d7014-c475-5bb9-87c3-772c3e34a011
2026-03-24 22:50:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee1d7014-c475-5bb9-87c3-772c3e34a011, skipping ID generation
2026-03-24 22:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee1d7014-c475-5bb9-87c3-772c3e34a011 with scrape type 1
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee1d7014-c475-5bb9-87c3-772c3e34a011 sending to next pipeline
2026-03-24 22:50:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee1d7014-c475-5bb9-87c3-772c3e34a011, identifier: 1980288
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/3.jpg not downloaded yet
2026-03-24 22:50:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1980288
2026-03-24 22:50:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1980288
2026-03-24 22:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1980288 to the API
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ee1d7014-c475-5bb9-87c3-772c3e34a011',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 58479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee1d7014-c475-5bb9-87c3-772c3e34a011/ee1d7014-c475-5bb9-87c3-772c3e34a011_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/4fd2024514234b52a0ade51159858024/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving School    Double '
          'Pedal',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving School    Double Pedal',
 'vin': None,
 'year': 2023}
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980288%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [ayvens.be] INFO: Saving data for 1980288: {'created_time': 1774392637.928144, 'last_price_update_time': 1774392637.928157, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980288') HTTP/1.1" 204 0
2026-03-24 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/4.jpg not downloaded yet
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009011a90>
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/1.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab1d0>
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/3.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a1cd0>
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/2.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/5.jpg not downloaded yet
2026-03-24 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/6.jpg not downloaded yet
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab810>
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/6.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/7.jpg not downloaded yet
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/8.jpg not downloaded yet
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083835d0>
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/7.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440b90>
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/8.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834f890>
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/5.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2b310>
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/10.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095abb50>
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/9.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836aa10>
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F56ba40fed14c4392acd6ec124cbece71%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/4.jpg saved to cache
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dddc1730-e2f6-59ba-acb6-05479044fc6d
2026-03-24 22:50:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dddc1730-e2f6-59ba-acb6-05479044fc6d, skipping ID generation
2026-03-24 22:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddc1730-e2f6-59ba-acb6-05479044fc6d with scrape type 1
2026-03-24 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dddc1730-e2f6-59ba-acb6-05479044fc6d sending to next pipeline
2026-03-24 22:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dddc1730-e2f6-59ba-acb6-05479044fc6d, identifier: 1980289
2026-03-24 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/9.jpg not downloaded yet
2026-03-24 22:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1980289
2026-03-24 22:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1980289
2026-03-24 22:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1980289 to the API
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dddc1730-e2f6-59ba-acb6-05479044fc6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 54057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddc1730-e2f6-59ba-acb6-05479044fc6d/dddc1730-e2f6-59ba-acb6-05479044fc6d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/56ba40fed14c4392acd6ec124cbece71/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980289%27 HTTP/1.1" 200 None
2026-03-24 22:50:39 [ayvens.be] INFO: Saving data for 1980289: {'created_time': 1774392639.36154, 'last_price_update_time': 1774392639.361549, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980289') HTTP/1.1" 204 0
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/10.jpg not downloaded yet
2026-03-24 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343910>
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/1.jpg saved to cache
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:39 [ayvens.be] INFO: Found listing with ID: 1980291
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980291%27 HTTP/1.1" 200 None
2026-03-24 22:50:39 [ayvens.be] INFO: Scrape type for 1980291: 1
2026-03-24 22:50:39 [ayvens.be] INFO: Extracting data for car ID: 1980291
2026-03-24 22:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1980291
2026-03-24 22:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2dfeb37-a687-5958-9f0b-f61b0318d841 with scrape type 1
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/1.jpg not downloaded yet
2026-03-24 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/2.jpg not downloaded yet
2026-03-24 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962da90>
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/2.jpg saved to cache
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6550>
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/3.jpg saved to cache
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/3.jpg not downloaded yet
2026-03-24 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/4.jpg not downloaded yet
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830b590>
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/6.jpg saved to cache
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009839190>
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/5.jpg saved to cache
2026-03-24 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091309d0>
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/4.jpg saved to cache
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838390>
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/7.jpg saved to cache
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/5.jpg not downloaded yet
2026-03-24 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/6.jpg not downloaded yet
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3e90>
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/8.jpg saved to cache
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/7.jpg not downloaded yet
2026-03-24 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/8.jpg not downloaded yet
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772ad0>
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/9.jpg saved to cache
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962cd90>
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6a2e0e7996964cdf8ae6ef669e80e4c9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/10.jpg saved to cache
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7d88768-9bf6-5f29-90de-1b51ec377c95
2026-03-24 22:50:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7d88768-9bf6-5f29-90de-1b51ec377c95, skipping ID generation
2026-03-24 22:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d88768-9bf6-5f29-90de-1b51ec377c95 with scrape type 1
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7d88768-9bf6-5f29-90de-1b51ec377c95 sending to next pipeline
2026-03-24 22:50:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7d88768-9bf6-5f29-90de-1b51ec377c95, identifier: 1980290
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/9.jpg not downloaded yet
2026-03-24 22:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1980290
2026-03-24 22:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1980290
2026-03-24 22:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1980290 to the API
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'b7d88768-9bf6-5f29-90de-1b51ec377c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 77898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d88768-9bf6-5f29-90de-1b51ec377c95/b7d88768-9bf6-5f29-90de-1b51ec377c95_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6a2e0e7996964cdf8ae6ef669e80e4c9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON BEV 71KWH 50 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 71KWH 50 QUATTRO S-LINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980290%27 HTTP/1.1" 200 None
2026-03-24 22:50:40 [ayvens.be] INFO: Saving data for 1980290: {'created_time': 1774392640.787156, 'last_price_update_time': 1774392640.787168, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980290') HTTP/1.1" 204 0
2026-03-24 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/10.jpg not downloaded yet
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019950>
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/1.jpg saved to cache
2026-03-24 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009773610>
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/2.jpg saved to cache
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:41 [ayvens.be] INFO: Found listing with ID: 1980292
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980292%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [ayvens.be] INFO: Scrape type for 1980292: 1
2026-03-24 22:50:41 [ayvens.be] INFO: Extracting data for car ID: 1980292
2026-03-24 22:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd75f594-b3c6-5c35-bca6-b8f604790c03 with identifier: 1980292
2026-03-24 22:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd75f594-b3c6-5c35-bca6-b8f604790c03 with scrape type 1
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/1.jpg not downloaded yet
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/2.jpg not downloaded yet
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c21d0>
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/3.jpg saved to cache
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/3.jpg not downloaded yet
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/4.jpg not downloaded yet
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097908d0>
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/6.jpg saved to cache
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097609d0>
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/4.jpg saved to cache
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0b10>
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/5.jpg saved to cache
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912b2d0>
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/7.jpg saved to cache
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/5.jpg not downloaded yet
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/6.jpg not downloaded yet
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018210>
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/8.jpg saved to cache
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/7.jpg not downloaded yet
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/8.jpg not downloaded yet
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/9.jpg not downloaded yet
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009566490>
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/9.jpg saved to cache
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/10.jpg not downloaded yet
2026-03-24 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:41 [ayvens.be] INFO: Found listing with ID: 1980293
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980293%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [ayvens.be] INFO: Scrape type for 1980293: 1
2026-03-24 22:50:41 [ayvens.be] INFO: Extracting data for car ID: 1980293
2026-03-24 22:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1980293
2026-03-24 22:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01115e5d-60ff-5dfb-bc55-79d8d479682e with scrape type 1
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/1.jpg not downloaded yet
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e1610>
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F53d4389cc25148828aa1094a07f0cbc2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/10.jpg saved to cache
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2dfeb37-a687-5958-9f0b-f61b0318d841
2026-03-24 22:50:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2dfeb37-a687-5958-9f0b-f61b0318d841, skipping ID generation
2026-03-24 22:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2dfeb37-a687-5958-9f0b-f61b0318d841 with scrape type 1
2026-03-24 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2dfeb37-a687-5958-9f0b-f61b0318d841 sending to next pipeline
2026-03-24 22:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2dfeb37-a687-5958-9f0b-f61b0318d841, identifier: 1980291
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094645d0>
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/2.jpg saved to cache
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1980291
2026-03-24 22:50:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1980291
2026-03-24 22:50:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1980291 to the API
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd2dfeb37-a687-5958-9f0b-f61b0318d841',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 89510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2dfeb37-a687-5958-9f0b-f61b0318d841/d2dfeb37-a687-5958-9f0b-f61b0318d841_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/53d4389cc25148828aa1094a07f0cbc2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS LINE DCT SH '
          'BR',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS LINE DCT SH BR',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980291%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [ayvens.be] INFO: Saving data for 1980291: {'created_time': 1774392642.301623, 'last_price_update_time': 1774392642.301632, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980291') HTTP/1.1" 204 0
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914d290>
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/1.jpg saved to cache
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/2.jpg not downloaded yet
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317dd0>
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/4.jpg saved to cache
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/3.jpg not downloaded yet
2026-03-24 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/4.jpg not downloaded yet
2026-03-24 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/5.jpg not downloaded yet
2026-03-24 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/6.jpg not downloaded yet
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/7.jpg not downloaded yet
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/8.jpg not downloaded yet
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/9.jpg not downloaded yet
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b95d0>
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/5.jpg saved to cache
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/10.jpg not downloaded yet
2026-03-24 22:50:42 [ayvens.be] INFO: Found listing with ID: 1980294
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980294%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [ayvens.be] INFO: Scrape type for 1980294: 1
2026-03-24 22:50:42 [ayvens.be] INFO: Extracting data for car ID: 1980294
2026-03-24 22:50:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1980294
2026-03-24 22:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e with scrape type 1
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/1.jpg not downloaded yet
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cd9390>
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/3.jpg saved to cache
2026-03-24 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b6450>
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/7.jpg saved to cache
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009793450>
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/9.jpg saved to cache
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009122f90>
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/6.jpg saved to cache
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009790890>
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/8.jpg saved to cache
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382190>
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F0083b51ae71246c8a75a7043dfba3f0a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/10.jpg saved to cache
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd75f594-b3c6-5c35-bca6-b8f604790c03
2026-03-24 22:50:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd75f594-b3c6-5c35-bca6-b8f604790c03, skipping ID generation
2026-03-24 22:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd75f594-b3c6-5c35-bca6-b8f604790c03 with scrape type 1
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd75f594-b3c6-5c35-bca6-b8f604790c03 sending to next pipeline
2026-03-24 22:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fd75f594-b3c6-5c35-bca6-b8f604790c03, identifier: 1980292
2026-03-24 22:50:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fd75f594-b3c6-5c35-bca6-b8f604790c03 with identifier: 1980292
2026-03-24 22:50:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fd75f594-b3c6-5c35-bca6-b8f604790c03 with identifier: 1980292
2026-03-24 22:50:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fd75f594-b3c6-5c35-bca6-b8f604790c03 with identifier: 1980292 to the API
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fd75f594-b3c6-5c35-bca6-b8f604790c03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 80299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd75f594-b3c6-5c35-bca6-b8f604790c03/fd75f594-b3c6-5c35-bca6-b8f604790c03_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/0083b51ae71246c8a75a7043dfba3f0a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980292%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [ayvens.be] INFO: Saving data for 1980292: {'created_time': 1774392643.693727, 'last_price_update_time': 1774392643.693737, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980292') HTTP/1.1" 204 0
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/2.jpg not downloaded yet
2026-03-24 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/3.jpg not downloaded yet
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/4.jpg not downloaded yet
2026-03-24 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/5.jpg not downloaded yet
2026-03-24 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/6.jpg not downloaded yet
2026-03-24 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/7.jpg not downloaded yet
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/8.jpg not downloaded yet
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a9490>
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/2.jpg saved to cache
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/9.jpg not downloaded yet
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/10.jpg not downloaded yet
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664a10>
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/1.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fb010>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/3.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938e2d0>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/4.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334910>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/5.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834fd10>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/6.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8210>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/7.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fb590>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/8.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:44 [ayvens.be] INFO: Found listing with ID: 1980295
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980295%27 HTTP/1.1" 200 None
2026-03-24 22:50:44 [ayvens.be] INFO: Scrape type for 1980295: 1
2026-03-24 22:50:44 [ayvens.be] INFO: Extracting data for car ID: 1980295
2026-03-24 22:50:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1980295
2026-03-24 22:50:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d54a7ee4-2d8b-566b-a509-c22bcb737f83 with scrape type 1
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/1.jpg not downloaded yet
2026-03-24 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/2.jpg not downloaded yet
2026-03-24 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/3.jpg not downloaded yet
2026-03-24 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/4.jpg not downloaded yet
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/5.jpg not downloaded yet
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/6.jpg not downloaded yet
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/7.jpg not downloaded yet
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761110>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/9.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910e390>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/2.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938cd50>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/4.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3010>
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/1.jpg saved to cache
2026-03-24 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/8.jpg not downloaded yet
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0d50>
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/5.jpg saved to cache
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638050>
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/3.jpg saved to cache
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912a3d0>
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F43aacac756164ba085aa2cc8f7bdec67%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/10.jpg saved to cache
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01115e5d-60ff-5dfb-bc55-79d8d479682e
2026-03-24 22:50:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01115e5d-60ff-5dfb-bc55-79d8d479682e, skipping ID generation
2026-03-24 22:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01115e5d-60ff-5dfb-bc55-79d8d479682e with scrape type 1
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01115e5d-60ff-5dfb-bc55-79d8d479682e sending to next pipeline
2026-03-24 22:50:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 01115e5d-60ff-5dfb-bc55-79d8d479682e, identifier: 1980293
2026-03-24 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/9.jpg not downloaded yet
2026-03-24 22:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1980293
2026-03-24 22:50:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1980293
2026-03-24 22:50:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1980293 to the API
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'CAVANSITE BLUE METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '01115e5d-60ff-5dfb-bc55-79d8d479682e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 215432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01115e5d-60ff-5dfb-bc55-79d8d479682e/01115e5d-60ff-5dfb-bc55-79d8d479682e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/43aacac756164ba085aa2cc8f7bdec67/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980293%27 HTTP/1.1" 200 None
2026-03-24 22:50:45 [ayvens.be] INFO: Saving data for 1980293: {'created_time': 1774392645.885804, 'last_price_update_time': 1774392645.885813, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980293') HTTP/1.1" 204 0
2026-03-24 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/10.jpg not downloaded yet
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a29710>
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/7.jpg saved to cache
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:46 [ayvens.be] INFO: Found listing with ID: 1980296
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980296%27 HTTP/1.1" 200 None
2026-03-24 22:50:46 [ayvens.be] INFO: Scrape type for 1980296: 1
2026-03-24 22:50:46 [ayvens.be] INFO: Extracting data for car ID: 1980296
2026-03-24 22:50:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1980296
2026-03-24 22:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faea3369-91d8-5b91-a94c-ab1ee56c2f75 with scrape type 1
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/1.jpg not downloaded yet
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836a750>
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/10.jpg saved to cache
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008373990>
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/9.jpg saved to cache
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/2.jpg not downloaded yet
2026-03-24 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405450>
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/8.jpg saved to cache
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfc710>
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252F3b5fb820779e482da875aeb3c4a0c557%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/6.jpg saved to cache
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e
2026-03-24 22:50:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06d66e48-2f7e-53b5-a957-8c3f93250b6e, skipping ID generation
2026-03-24 22:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e with scrape type 1
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e sending to next pipeline
2026-03-24 22:50:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 06d66e48-2f7e-53b5-a957-8c3f93250b6e, identifier: 1980294
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb2f50>
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/3.jpg saved to cache
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962fdd0>
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/1.jpg saved to cache
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009470590>
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/2.jpg saved to cache
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/3.jpg not downloaded yet
2026-03-24 22:50:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1980294
2026-03-24 22:50:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1980294
2026-03-24 22:50:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1980294 to the API
2026-03-24 22:50:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 10835175,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '06d66e48-2f7e-53b5-a957-8c3f93250b6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 35175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d66e48-2f7e-53b5-a957-8c3f93250b6e/06d66e48-2f7e-53b5-a957-8c3f93250b6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/3b5fb820779e482da875aeb3c4a0c557/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.0 TSI 81KW LIFE BUSINESS',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980294%27 HTTP/1.1" 200 None
2026-03-24 22:50:47 [ayvens.be] INFO: Saving data for 1980294: {'created_time': 1774392647.265752, 'last_price_update_time': 1774392647.265761, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980294') HTTP/1.1" 204 0
2026-03-24 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/4.jpg not downloaded yet
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b9d10>
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/4.jpg saved to cache
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009397ed0>
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/6.jpg saved to cache
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/5.jpg not downloaded yet
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009395bd0>
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/5.jpg saved to cache
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613e50>
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/7.jpg saved to cache
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/6.jpg not downloaded yet
2026-03-24 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/7.jpg not downloaded yet
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018350>
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/8.jpg saved to cache
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/8.jpg not downloaded yet
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/9.jpg not downloaded yet
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008358590>
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/9.jpg saved to cache
2026-03-24 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3d10>
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fdfc3db5770084720b5c5e146a84c9943%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/10.jpg saved to cache
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d54a7ee4-2d8b-566b-a509-c22bcb737f83
2026-03-24 22:50:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d54a7ee4-2d8b-566b-a509-c22bcb737f83, skipping ID generation
2026-03-24 22:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d54a7ee4-2d8b-566b-a509-c22bcb737f83 with scrape type 1
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d54a7ee4-2d8b-566b-a509-c22bcb737f83 sending to next pipeline
2026-03-24 22:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d54a7ee4-2d8b-566b-a509-c22bcb737f83, identifier: 1980295
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/10.jpg not downloaded yet
2026-03-24 22:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1980295
2026-03-24 22:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1980295
2026-03-24 22:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1980295 to the API
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd54a7ee4-2d8b-566b-a509-c22bcb737f83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 94918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d54a7ee4-2d8b-566b-a509-c22bcb737f83/d54a7ee4-2d8b-566b-a509-c22bcb737f83_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/dfc3db5770084720b5c5e146a84c9943/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980295%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [ayvens.be] INFO: Saving data for 1980295: {'created_time': 1774392648.45066, 'last_price_update_time': 1774392648.450669, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980295') HTTP/1.1" 204 0
2026-03-24 22:50:48 [ayvens.be] INFO: Found listing with ID: 1980297
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980297%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [ayvens.be] INFO: Scrape type for 1980297: 1
2026-03-24 22:50:48 [ayvens.be] INFO: Extracting data for car ID: 1980297
2026-03-24 22:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1980297
2026-03-24 22:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with scrape type 1
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/1.jpg not downloaded yet
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94dd0>
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/1.jpg saved to cache
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978b410>
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/2.jpg saved to cache
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/2.jpg not downloaded yet
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/3.jpg not downloaded yet
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/4.jpg not downloaded yet
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed80d0>
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/3.jpg saved to cache
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/5.jpg not downloaded yet
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/6.jpg not downloaded yet
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/7.jpg not downloaded yet
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009792210>
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/5.jpg saved to cache
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/8.jpg not downloaded yet
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/9.jpg not downloaded yet
2026-03-24 22:50:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873c50>
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/4.jpg saved to cache
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405610>
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/7.jpg saved to cache
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a6bd0>
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/6.jpg saved to cache
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094079d0>
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/8.jpg saved to cache
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/10.jpg not downloaded yet
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008368f50>
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/9.jpg saved to cache
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:49 [ayvens.be] INFO: Found listing with ID: 1980298
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980298%27 HTTP/1.1" 200 None
2026-03-24 22:50:49 [ayvens.be] INFO: Scrape type for 1980298: 1
2026-03-24 22:50:49 [ayvens.be] INFO: Extracting data for car ID: 1980298
2026-03-24 22:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1980298
2026-03-24 22:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b232f238-ff97-549b-a6d4-bacd62f8dff8 with scrape type 1
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/1.jpg not downloaded yet
2026-03-24 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b95d0>
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/1.jpg saved to cache
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009141850>
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fed3e2ffda9ad4cbfbae050e42b85dde3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/10.jpg saved to cache
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item faea3369-91d8-5b91-a94c-ab1ee56c2f75
2026-03-24 22:50:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faea3369-91d8-5b91-a94c-ab1ee56c2f75, skipping ID generation
2026-03-24 22:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faea3369-91d8-5b91-a94c-ab1ee56c2f75 with scrape type 1
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faea3369-91d8-5b91-a94c-ab1ee56c2f75 sending to next pipeline
2026-03-24 22:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: faea3369-91d8-5b91-a94c-ab1ee56c2f75, identifier: 1980296
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/2.jpg not downloaded yet
2026-03-24 22:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1980296
2026-03-24 22:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1980296
2026-03-24 22:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1980296 to the API
2026-03-24 22:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'faea3369-91d8-5b91-a94c-ab1ee56c2f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 85359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faea3369-91d8-5b91-a94c-ab1ee56c2f75/faea3369-91d8-5b91-a94c-ab1ee56c2f75_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/ed3e2ffda9ad4cbfbae050e42b85dde3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980296%27 HTTP/1.1" 200 None
2026-03-24 22:50:50 [ayvens.be] INFO: Saving data for 1980296: {'created_time': 1774392650.269312, 'last_price_update_time': 1774392650.269322, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980296') HTTP/1.1" 204 0
2026-03-24 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/3.jpg not downloaded yet
2026-03-24 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b8d90>
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/3.jpg saved to cache
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971b950>
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/2.jpg saved to cache
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a5b50>
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/4.jpg saved to cache
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/4.jpg not downloaded yet
2026-03-24 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/5.jpg not downloaded yet
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b62ad0>
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/5.jpg saved to cache
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfe450>
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/6.jpg saved to cache
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009176e50>
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/7.jpg saved to cache
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfc890>
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/9.jpg saved to cache
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/6.jpg not downloaded yet
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/7.jpg not downloaded yet
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008342750>
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/8.jpg saved to cache
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009942350>
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F956b0782312946bf9c183efdeb676ea7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/10.jpg saved to cache
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66
2026-03-24 22:50:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66, skipping ID generation
2026-03-24 22:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with scrape type 1
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 sending to next pipeline
2026-03-24 22:50:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66, identifier: 1980297
2026-03-24 22:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1980297
2026-03-24 22:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1980297
2026-03-24 22:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1980297 to the API
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c729140a-a6ea-5cdb-874c-9d2dbfa6cd66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 150408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c729140a-a6ea-5cdb-874c-9d2dbfa6cd66/c729140a-a6ea-5cdb-874c-9d2dbfa6cd66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/956b0782312946bf9c183efdeb676ea7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980297%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [ayvens.be] INFO: Saving data for 1980297: {'created_time': 1774392651.599437, 'last_price_update_time': 1774392651.599454, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980297') HTTP/1.1" 204 0
2026-03-24 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/8.jpg not downloaded yet
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/9.jpg not downloaded yet
2026-03-24 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/10.jpg not downloaded yet
2026-03-24 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:51 [ayvens.be] INFO: Found listing with ID: 1980299
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980299%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [ayvens.be] INFO: Scrape type for 1980299: 1
2026-03-24 22:50:51 [ayvens.be] INFO: Extracting data for car ID: 1980299
2026-03-24 22:50:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f27df9-0592-58bd-bbc2-2af169486214 with identifier: 1980299
2026-03-24 22:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f27df9-0592-58bd-bbc2-2af169486214 with scrape type 1
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/1.jpg not downloaded yet
2026-03-24 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/2.jpg not downloaded yet
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/3.jpg not downloaded yet
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772010>
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/1.jpg saved to cache
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/4.jpg not downloaded yet
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/5.jpg not downloaded yet
2026-03-24 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf70d0>
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/2.jpg saved to cache
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b6050>
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/3.jpg saved to cache
2026-03-24 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096119d0>
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/5.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0090184d0>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/4.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/6.jpg not downloaded yet
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/7.jpg not downloaded yet
2026-03-24 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0790>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/6.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008370590>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/7.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/8.jpg not downloaded yet
2026-03-24 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/9.jpg not downloaded yet
2026-03-24 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914d550>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/8.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009566390>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/1.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/10.jpg not downloaded yet
2026-03-24 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:52 [ayvens.be] INFO: Found listing with ID: 1980300
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980300%27 HTTP/1.1" 200 None
2026-03-24 22:50:52 [ayvens.be] INFO: Scrape type for 1980300: 1
2026-03-24 22:50:52 [ayvens.be] INFO: Extracting data for car ID: 1980300
2026-03-24 22:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1980300
2026-03-24 22:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221e3902-9489-55a3-aab9-96890baab06c with scrape type 1
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/1.jpg not downloaded yet
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836a7d0>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/10.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009011ad0>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/3.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008399cd0>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/2.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008398dd0>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/4.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009465490>
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd8394ea4d5114ffabea8f9101a353c3f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/9.jpg saved to cache
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b232f238-ff97-549b-a6d4-bacd62f8dff8
2026-03-24 22:50:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b232f238-ff97-549b-a6d4-bacd62f8dff8, skipping ID generation
2026-03-24 22:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b232f238-ff97-549b-a6d4-bacd62f8dff8 with scrape type 1
2026-03-24 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b232f238-ff97-549b-a6d4-bacd62f8dff8 sending to next pipeline
2026-03-24 22:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b232f238-ff97-549b-a6d4-bacd62f8dff8, identifier: 1980298
2026-03-24 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/2.jpg not downloaded yet
2026-03-24 22:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1980298
2026-03-24 22:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1980298
2026-03-24 22:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1980298 to the API
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b232f238-ff97-549b-a6d4-bacd62f8dff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 154342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b232f238-ff97-549b-a6d4-bacd62f8dff8/b232f238-ff97-549b-a6d4-bacd62f8dff8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d8394ea4d5114ffabea8f9101a353c3f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980298%27 HTTP/1.1" 200 None
2026-03-24 22:50:53 [ayvens.be] INFO: Saving data for 1980298: {'created_time': 1774392653.376916, 'last_price_update_time': 1774392653.376926, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980298') HTTP/1.1" 204 0
2026-03-24 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/3.jpg not downloaded yet
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978bdd0>
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/5.jpg saved to cache
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2a890>
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/6.jpg saved to cache
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/4.jpg not downloaded yet
2026-03-24 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/5.jpg not downloaded yet
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2ac50>
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/7.jpg saved to cache
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/6.jpg not downloaded yet
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/7.jpg not downloaded yet
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a1c10>
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/8.jpg saved to cache
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e3990>
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/10.jpg saved to cache
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009567f50>
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F7da9b545e8bc4546959162c5d3968269%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/9.jpg saved to cache
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3f27df9-0592-58bd-bbc2-2af169486214
2026-03-24 22:50:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3f27df9-0592-58bd-bbc2-2af169486214, skipping ID generation
2026-03-24 22:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f27df9-0592-58bd-bbc2-2af169486214 with scrape type 1
2026-03-24 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3f27df9-0592-58bd-bbc2-2af169486214 sending to next pipeline
2026-03-24 22:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3f27df9-0592-58bd-bbc2-2af169486214, identifier: 1980299
2026-03-24 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/8.jpg not downloaded yet
2026-03-24 22:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3f27df9-0592-58bd-bbc2-2af169486214 with identifier: 1980299
2026-03-24 22:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3f27df9-0592-58bd-bbc2-2af169486214 with identifier: 1980299
2026-03-24 22:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3f27df9-0592-58bd-bbc2-2af169486214 with identifier: 1980299 to the API
2026-03-24 22:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a3f27df9-0592-58bd-bbc2-2af169486214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 163774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3f27df9-0592-58bd-bbc2-2af169486214/a3f27df9-0592-58bd-bbc2-2af169486214_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/7da9b545e8bc4546959162c5d3968269/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980299%27 HTTP/1.1" 200 None
2026-03-24 22:50:55 [ayvens.be] INFO: Saving data for 1980299: {'created_time': 1774392655.694483, 'last_price_update_time': 1774392655.694494, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980299') HTTP/1.1" 204 0
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/9.jpg not downloaded yet
2026-03-24 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/10.jpg not downloaded yet
2026-03-24 22:50:55 [ayvens.be] INFO: Found listing with ID: 1980301
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980301%27 HTTP/1.1" 200 None
2026-03-24 22:50:55 [ayvens.be] INFO: Scrape type for 1980301: 1
2026-03-24 22:50:55 [ayvens.be] INFO: Extracting data for car ID: 1980301
2026-03-24 22:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1980301
2026-03-24 22:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with scrape type 1
2026-03-24 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/1.jpg not downloaded yet
2026-03-24 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/2.jpg not downloaded yet
2026-03-24 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/3.jpg not downloaded yet
2026-03-24 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/4.jpg not downloaded yet
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/5.jpg not downloaded yet
2026-03-24 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938e190>
2026-03-24 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/1.jpg saved to cache
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/6.jpg not downloaded yet
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/7.jpg not downloaded yet
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835a2d0>
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/2.jpg saved to cache
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839ad10>
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/3.jpg saved to cache
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335410>
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/4.jpg saved to cache
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083994d0>
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/5.jpg saved to cache
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ab4d0>
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/6.jpg saved to cache
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/8.jpg not downloaded yet
2026-03-24 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/9.jpg not downloaded yet
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/10.jpg not downloaded yet
2026-03-24 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:56 [ayvens.be] INFO: Found listing with ID: 1980302
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980302%27 HTTP/1.1" 200 None
2026-03-24 22:50:56 [ayvens.be] INFO: Scrape type for 1980302: 1
2026-03-24 22:50:56 [ayvens.be] INFO: Extracting data for car ID: 1980302
2026-03-24 22:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1980302
2026-03-24 22:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8897836b-5393-5b54-b0d9-9b410fbd8588 with scrape type 1
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/1.jpg not downloaded yet
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838dfd0>
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/8.jpg saved to cache
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/2.jpg not downloaded yet
2026-03-24 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/3.jpg not downloaded yet
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009762750>
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/9.jpg saved to cache
2026-03-24 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915d650>
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/7.jpg saved to cache
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963b0d0>
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/1.jpg saved to cache
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091918d0>
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F1b62a63f574f473fa6094ce09d0b0862%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/10.jpg saved to cache
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 221e3902-9489-55a3-aab9-96890baab06c
2026-03-24 22:50:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 221e3902-9489-55a3-aab9-96890baab06c, skipping ID generation
2026-03-24 22:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221e3902-9489-55a3-aab9-96890baab06c with scrape type 1
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 221e3902-9489-55a3-aab9-96890baab06c sending to next pipeline
2026-03-24 22:50:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 221e3902-9489-55a3-aab9-96890baab06c, identifier: 1980300
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00c8e9810>
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/2.jpg saved to cache
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1980300
2026-03-24 22:50:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1980300
2026-03-24 22:50:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1980300 to the API
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '221e3902-9489-55a3-aab9-96890baab06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 BERLINE',
 'odometer': 101350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_221e3902-9489-55a3-aab9-96890baab06c/221e3902-9489-55a3-aab9-96890baab06c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/1b62a63f574f473fa6094ce09d0b0862/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 BERLINE 1.0 TFSI 30 81KW ATTRACTION',
 'transmission': 'manual',
 'trim': '1.0 TFSI 30 81KW ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980300%27 HTTP/1.1" 200 None
2026-03-24 22:50:57 [ayvens.be] INFO: Saving data for 1980300: {'created_time': 1774392657.7435, 'last_price_update_time': 1774392657.743511, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980300') HTTP/1.1" 204 0
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/4.jpg not downloaded yet
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/5.jpg not downloaded yet
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed2290>
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/3.jpg saved to cache
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121bd0>
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/4.jpg saved to cache
2026-03-24 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/6.jpg not downloaded yet
2026-03-24 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/7.jpg not downloaded yet
2026-03-24 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/8.jpg not downloaded yet
2026-03-24 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/9.jpg not downloaded yet
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/10.jpg not downloaded yet
2026-03-24 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009009190>
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/1.jpg saved to cache
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:58 [ayvens.be] INFO: Found listing with ID: 1980303
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980303%27 HTTP/1.1" 200 None
2026-03-24 22:50:58 [ayvens.be] INFO: Scrape type for 1980303: 1
2026-03-24 22:50:58 [ayvens.be] INFO: Extracting data for car ID: 1980303
2026-03-24 22:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1980303
2026-03-24 22:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86c029b-7f83-5f8f-b81d-a7e0e4164053 with scrape type 1
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/1.jpg not downloaded yet
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ede50>
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/6.jpg saved to cache
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/2.jpg not downloaded yet
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ccf90>
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/5.jpg saved to cache
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009198a50>
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/7.jpg saved to cache
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008387f90>
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/9.jpg saved to cache
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013dd0>
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/10.jpg saved to cache
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009629cd0>
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252Fbf689aa0f1fc4a07a45c552c58f77513%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/8.jpg saved to cache
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf
2026-03-24 22:50:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf, skipping ID generation
2026-03-24 22:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with scrape type 1
2026-03-24 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf sending to next pipeline
2026-03-24 22:50:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf, identifier: 1980301
2026-03-24 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1980301
2026-03-24 22:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1980301
2026-03-24 22:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1980301 to the API
2026-03-24 22:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '5e0caed5-1fb6-58fb-a2e6-65e6018b09cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 121863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e0caed5-1fb6-58fb-a2e6-65e6018b09cf/5e0caed5-1fb6-58fb-a2e6-65e6018b09cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/bf689aa0f1fc4a07a45c552c58f77513/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980301%27 HTTP/1.1" 200 None
2026-03-24 22:50:59 [ayvens.be] INFO: Saving data for 1980301: {'created_time': 1774392659.201921, 'last_price_update_time': 1774392659.201934, 'auction_closing_time': 1774530000.0}
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980301') HTTP/1.1" 204 0
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/3.jpg not downloaded yet
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406c50>
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/3.jpg saved to cache
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/4.jpg not downloaded yet
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a15d0>
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/2.jpg saved to cache
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/5.jpg not downloaded yet
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666110>
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/5.jpg saved to cache
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cc090>
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/6.jpg saved to cache
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b6d50>
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/4.jpg saved to cache
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/6.jpg not downloaded yet
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/7.jpg not downloaded yet
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449a90>
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/8.jpg saved to cache
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009665790>
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/7.jpg saved to cache
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406310>
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/10.jpg saved to cache
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/8.jpg not downloaded yet
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/9.jpg not downloaded yet
2026-03-24 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cf090>
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F004ea8c676a04cedb4e90950659777bd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/9.jpg saved to cache
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8897836b-5393-5b54-b0d9-9b410fbd8588
2026-03-24 22:51:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8897836b-5393-5b54-b0d9-9b410fbd8588, skipping ID generation
2026-03-24 22:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8897836b-5393-5b54-b0d9-9b410fbd8588 with scrape type 1
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8897836b-5393-5b54-b0d9-9b410fbd8588 sending to next pipeline
2026-03-24 22:51:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8897836b-5393-5b54-b0d9-9b410fbd8588, identifier: 1980302
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8c90>
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/2.jpg saved to cache
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/10.jpg not downloaded yet
2026-03-24 22:51:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1980302
2026-03-24 22:51:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1980302
2026-03-24 22:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1980302 to the API
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8897836b-5393-5b54-b0d9-9b410fbd8588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 101953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8897836b-5393-5b54-b0d9-9b410fbd8588/8897836b-5393-5b54-b0d9-9b410fbd8588_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/004ea8c676a04cedb4e90950659777bd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980302%27 HTTP/1.1" 200 None
2026-03-24 22:51:00 [ayvens.be] INFO: Saving data for 1980302: {'created_time': 1774392660.628051, 'last_price_update_time': 1774392660.628061, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980302') HTTP/1.1" 204 0
2026-03-24 22:51:00 [ayvens.be] INFO: Found listing with ID: 1980304
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980304%27 HTTP/1.1" 200 None
2026-03-24 22:51:00 [ayvens.be] INFO: Scrape type for 1980304: 1
2026-03-24 22:51:00 [ayvens.be] INFO: Extracting data for car ID: 1980304
2026-03-24 22:51:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1980304
2026-03-24 22:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7320108-93e1-5815-b2ae-f9adc20ddb67 with scrape type 1
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/1.jpg not downloaded yet
2026-03-24 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666690>
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/1.jpg saved to cache
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944a890>
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/3.jpg saved to cache
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913f050>
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/4.jpg saved to cache
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464310>
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/5.jpg saved to cache
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/2.jpg not downloaded yet
2026-03-24 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/3.jpg not downloaded yet
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128310>
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/6.jpg saved to cache
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/4.jpg not downloaded yet
2026-03-24 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/5.jpg not downloaded yet
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/6.jpg not downloaded yet
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/7.jpg not downloaded yet
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131890>
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/7.jpg saved to cache
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b4950>
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/8.jpg saved to cache
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/8.jpg not downloaded yet
2026-03-24 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/9.jpg not downloaded yet
2026-03-24 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4d50>
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/9.jpg saved to cache
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/10.jpg not downloaded yet
2026-03-24 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:01 [ayvens.be] INFO: Found listing with ID: 1980305
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980305%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [ayvens.be] INFO: Scrape type for 1980305: 1
2026-03-24 22:51:01 [ayvens.be] INFO: Extracting data for car ID: 1980305
2026-03-24 22:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1980305
2026-03-24 22:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a90720-4e95-5ec8-a958-7d17809d3896 with scrape type 1
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/1.jpg not downloaded yet
2026-03-24 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/2.jpg not downloaded yet
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb3450>
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F508712930cd34f33a61ae8dafcd89d42%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/10.jpg saved to cache
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a86c029b-7f83-5f8f-b81d-a7e0e4164053
2026-03-24 22:51:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a86c029b-7f83-5f8f-b81d-a7e0e4164053, skipping ID generation
2026-03-24 22:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86c029b-7f83-5f8f-b81d-a7e0e4164053 with scrape type 1
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a86c029b-7f83-5f8f-b81d-a7e0e4164053 sending to next pipeline
2026-03-24 22:51:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a86c029b-7f83-5f8f-b81d-a7e0e4164053, identifier: 1980303
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8250>
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/1.jpg saved to cache
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913f510>
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/2.jpg saved to cache
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeafc90>
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/4.jpg saved to cache
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/3.jpg not downloaded yet
2026-03-24 22:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1980303
2026-03-24 22:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1980303
2026-03-24 22:51:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1980303 to the API
2026-03-24 22:51:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a86c029b-7f83-5f8f-b81d-a7e0e4164053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 93071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86c029b-7f83-5f8f-b81d-a7e0e4164053/a86c029b-7f83-5f8f-b81d-a7e0e4164053_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/508712930cd34f33a61ae8dafcd89d42/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980303%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [ayvens.be] INFO: Saving data for 1980303: {'created_time': 1774392662.1543, 'last_price_update_time': 1774392662.15431, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980303') HTTP/1.1" 204 0
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/4.jpg not downloaded yet
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838f9d0>
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/3.jpg saved to cache
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900b590>
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/5.jpg saved to cache
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131550>
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/6.jpg saved to cache
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/5.jpg not downloaded yet
2026-03-24 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/6.jpg not downloaded yet
2026-03-24 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/7.jpg not downloaded yet
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/8.jpg not downloaded yet
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/9.jpg not downloaded yet
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/10.jpg not downloaded yet
2026-03-24 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666050>
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/8.jpg saved to cache
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:02 [ayvens.be] INFO: Found listing with ID: 1980306
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980306%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [ayvens.be] INFO: Scrape type for 1980306: 1
2026-03-24 22:51:02 [ayvens.be] INFO: Extracting data for car ID: 1980306
2026-03-24 22:51:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1980306
2026-03-24 22:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e with scrape type 1
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/1.jpg not downloaded yet
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382090>
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/10.jpg saved to cache
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008324390>
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/7.jpg saved to cache
2026-03-24 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334d10>
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252Fac9938d982724c04a8be106bff9d01b1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/9.jpg saved to cache
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7320108-93e1-5815-b2ae-f9adc20ddb67
2026-03-24 22:51:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7320108-93e1-5815-b2ae-f9adc20ddb67, skipping ID generation
2026-03-24 22:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7320108-93e1-5815-b2ae-f9adc20ddb67 with scrape type 1
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7320108-93e1-5815-b2ae-f9adc20ddb67 sending to next pipeline
2026-03-24 22:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a7320108-93e1-5815-b2ae-f9adc20ddb67, identifier: 1980304
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/2.jpg not downloaded yet
2026-03-24 22:51:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1980304
2026-03-24 22:51:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1980304
2026-03-24 22:51:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1980304 to the API
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a7320108-93e1-5815-b2ae-f9adc20ddb67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 117996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7320108-93e1-5815-b2ae-f9adc20ddb67/a7320108-93e1-5815-b2ae-f9adc20ddb67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/ac9938d982724c04a8be106bff9d01b1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980304%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [ayvens.be] INFO: Saving data for 1980304: {'created_time': 1774392663.447879, 'last_price_update_time': 1774392663.447889, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980304') HTTP/1.1" 204 0
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009684c90>
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/1.jpg saved to cache
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/3.jpg not downloaded yet
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bedd0>
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/2.jpg saved to cache
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/4.jpg not downloaded yet
2026-03-24 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/5.jpg not downloaded yet
2026-03-24 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/6.jpg not downloaded yet
2026-03-24 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/7.jpg not downloaded yet
2026-03-24 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/8.jpg not downloaded yet
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/9.jpg not downloaded yet
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/10.jpg not downloaded yet
2026-03-24 22:51:03 [ayvens.be] INFO: Found listing with ID: 1980307
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980307%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [ayvens.be] INFO: Scrape type for 1980307: 1
2026-03-24 22:51:03 [ayvens.be] INFO: Extracting data for car ID: 1980307
2026-03-24 22:51:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1980307
2026-03-24 22:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec with scrape type 1
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/1.jpg not downloaded yet
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009565490>
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/3.jpg saved to cache
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/2.jpg not downloaded yet
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a3210>
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/4.jpg saved to cache
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971a250>
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/5.jpg saved to cache
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e0710>
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/8.jpg saved to cache
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405350>
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/7.jpg saved to cache
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c7150>
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/6.jpg saved to cache
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008326050>
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/10.jpg saved to cache
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e2ad0>
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F0f5ba300530149cda17a6e9aab1d8f0a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/9.jpg saved to cache
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7a90720-4e95-5ec8-a958-7d17809d3896
2026-03-24 22:51:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7a90720-4e95-5ec8-a958-7d17809d3896, skipping ID generation
2026-03-24 22:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a90720-4e95-5ec8-a958-7d17809d3896 with scrape type 1
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7a90720-4e95-5ec8-a958-7d17809d3896 sending to next pipeline
2026-03-24 22:51:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7a90720-4e95-5ec8-a958-7d17809d3896, identifier: 1980305
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/3.jpg not downloaded yet
2026-03-24 22:51:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1980305
2026-03-24 22:51:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1980305
2026-03-24 22:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1980305 to the API
2026-03-24 22:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e7a90720-4e95-5ec8-a958-7d17809d3896',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 95871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7a90720-4e95-5ec8-a958-7d17809d3896/e7a90720-4e95-5ec8-a958-7d17809d3896_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/0f5ba300530149cda17a6e9aab1d8f0a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 CLEVER',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980305%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [ayvens.be] INFO: Saving data for 1980305: {'created_time': 1774392665.250872, 'last_price_update_time': 1774392665.250882, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980305') HTTP/1.1" 204 0
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/4.jpg not downloaded yet
2026-03-24 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/5.jpg not downloaded yet
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/6.jpg not downloaded yet
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/7.jpg not downloaded yet
2026-03-24 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/8.jpg not downloaded yet
2026-03-24 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/9.jpg not downloaded yet
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/10.jpg not downloaded yet
2026-03-24 22:51:05 [ayvens.be] INFO: Found listing with ID: 1980308
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980308%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [ayvens.be] INFO: Scrape type for 1980308: 1
2026-03-24 22:51:05 [ayvens.be] INFO: Extracting data for car ID: 1980308
2026-03-24 22:51:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1980308
2026-03-24 22:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with scrape type 1
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/1.jpg not downloaded yet
2026-03-24 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442e10>
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/1.jpg saved to cache
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/2.jpg not downloaded yet
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/3.jpg not downloaded yet
2026-03-24 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/4.jpg not downloaded yet
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641910>
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/5.jpg saved to cache
2026-03-24 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d65d0>
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/2.jpg saved to cache
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083802d0>
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/4.jpg saved to cache
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128f50>
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/3.jpg saved to cache
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4890>
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/3.jpg saved to cache
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/5.jpg not downloaded yet
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838e510>
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/1.jpg saved to cache
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/6.jpg not downloaded yet
2026-03-24 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838dd10>
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/2.jpg saved to cache
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:06 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at -1 pages/min), scraped 295 items (at 37 items/min)
2026-03-24 22:51:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/7.jpg not downloaded yet
2026-03-24 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/8.jpg not downloaded yet
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/9.jpg not downloaded yet
2026-03-24 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/10.jpg not downloaded yet
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093dbdd0>
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/10.jpg saved to cache
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472b90>
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/7.jpg saved to cache
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:06 [ayvens.be] INFO: Found listing with ID: 1980309
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980309%27 HTTP/1.1" 200 None
2026-03-24 22:51:06 [ayvens.be] INFO: Scrape type for 1980309: 1
2026-03-24 22:51:06 [ayvens.be] INFO: Extracting data for car ID: 1980309
2026-03-24 22:51:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1980309
2026-03-24 22:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0475d773-c9bd-57d9-92ba-2afdf730d633 with scrape type 1
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/1.jpg not downloaded yet
2026-03-24 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/2.jpg not downloaded yet
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/3.jpg not downloaded yet
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c0a10>
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/8.jpg saved to cache
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb990>
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/9.jpg saved to cache
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610150>
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/4.jpg saved to cache
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a2d10>
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/5.jpg saved to cache
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bcf90>
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Ff9dab07cbf37489ba3b03ac9b8c4d91b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/6.jpg saved to cache
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e
2026-03-24 22:51:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3824f0f-7f9e-5c51-b42c-79ea05c8283e, skipping ID generation
2026-03-24 22:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e with scrape type 1
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e sending to next pipeline
2026-03-24 22:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d3824f0f-7f9e-5c51-b42c-79ea05c8283e, identifier: 1980306
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009861d90>
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/6.jpg saved to cache
2026-03-24 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1980306
2026-03-24 22:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1980306
2026-03-24 22:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1980306 to the API
2026-03-24 22:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd3824f0f-7f9e-5c51-b42c-79ea05c8283e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 60223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824f0f-7f9e-5c51-b42c-79ea05c8283e/d3824f0f-7f9e-5c51-b42c-79ea05c8283e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/f9dab07cbf37489ba3b03ac9b8c4d91b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980306%27 HTTP/1.1" 200 None
2026-03-24 22:51:08 [ayvens.be] INFO: Saving data for 1980306: {'created_time': 1774392668.735744, 'last_price_update_time': 1774392668.735753, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980306') HTTP/1.1" 204 0
2026-03-24 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/4.jpg not downloaded yet
2026-03-24 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/5.jpg not downloaded yet
2026-03-24 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/6.jpg not downloaded yet
2026-03-24 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009942390>
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/10.jpg saved to cache
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7a50>
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/9.jpg saved to cache
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8f10>
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/8.jpg saved to cache
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094401d0>
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F4b438ea527ae40349d6c668160fb5ea5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/7.jpg saved to cache
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec
2026-03-24 22:51:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3523fb47-4378-50b8-98c0-ddf9b02d04ec, skipping ID generation
2026-03-24 22:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec with scrape type 1
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec sending to next pipeline
2026-03-24 22:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3523fb47-4378-50b8-98c0-ddf9b02d04ec, identifier: 1980307
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/7.jpg not downloaded yet
2026-03-24 22:51:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1980307
2026-03-24 22:51:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1980307
2026-03-24 22:51:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1980307 to the API
2026-03-24 22:51:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3523fb47-4378-50b8-98c0-ddf9b02d04ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 93484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3523fb47-4378-50b8-98c0-ddf9b02d04ec/3523fb47-4378-50b8-98c0-ddf9b02d04ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/4b438ea527ae40349d6c668160fb5ea5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980307%27 HTTP/1.1" 200 None
2026-03-24 22:51:10 [ayvens.be] INFO: Saving data for 1980307: {'created_time': 1774392670.730977, 'last_price_update_time': 1774392670.730988, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980307') HTTP/1.1" 204 0
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/8.jpg not downloaded yet
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/9.jpg not downloaded yet
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8810>
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/1.jpg saved to cache
2026-03-24 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962bb10>
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/2.jpg saved to cache
2026-03-24 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a7a50>
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/3.jpg saved to cache
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/10.jpg not downloaded yet
2026-03-24 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:11 [ayvens.be] INFO: Found listing with ID: 1980310
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980310%27 HTTP/1.1" 200 None
2026-03-24 22:51:11 [ayvens.be] INFO: Scrape type for 1980310: 1
2026-03-24 22:51:11 [ayvens.be] INFO: Extracting data for car ID: 1980310
2026-03-24 22:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1980310
2026-03-24 22:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32ddf75-f711-5d8e-88f4-e2a8637663cd with scrape type 1
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/1.jpg not downloaded yet
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/2.jpg not downloaded yet
2026-03-24 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/3.jpg not downloaded yet
2026-03-24 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/4.jpg not downloaded yet
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096142d0>
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/4.jpg saved to cache
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/5.jpg not downloaded yet
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8290>
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/5.jpg saved to cache
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a0f90>
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/1.jpg saved to cache
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/6.jpg not downloaded yet
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/7.jpg not downloaded yet
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1110>
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/7.jpg saved to cache
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112b90>
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/10.jpg saved to cache
2026-03-24 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009942490>
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/6.jpg saved to cache
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962a190>
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/8.jpg saved to cache
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb3110>
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F2bfbdb0f2edc4d08b21cec2d031d135f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/9.jpg saved to cache
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17
2026-03-24 22:51:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17, skipping ID generation
2026-03-24 22:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with scrape type 1
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 sending to next pipeline
2026-03-24 22:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17, identifier: 1980308
2026-03-24 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1980308
2026-03-24 22:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1980308
2026-03-24 22:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1980308 to the API
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '3a2b7706-9cb9-50f9-bf45-1d72b1675d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 61319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a2b7706-9cb9-50f9-bf45-1d72b1675d17/3a2b7706-9cb9-50f9-bf45-1d72b1675d17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/2bfbdb0f2edc4d08b21cec2d031d135f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980308%27 HTTP/1.1" 200 None
2026-03-24 22:51:12 [ayvens.be] INFO: Saving data for 1980308: {'created_time': 1774392672.724936, 'last_price_update_time': 1774392672.724949, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980308') HTTP/1.1" 204 0
2026-03-24 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/8.jpg not downloaded yet
2026-03-24 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/9.jpg not downloaded yet
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cdb10>
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/2.jpg saved to cache
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009686890>
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/6.jpg saved to cache
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/10.jpg not downloaded yet
2026-03-24 22:51:12 [ayvens.be] INFO: Found listing with ID: 1980311
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980311%27 HTTP/1.1" 200 None
2026-03-24 22:51:12 [ayvens.be] INFO: Scrape type for 1980311: 1
2026-03-24 22:51:12 [ayvens.be] INFO: Extracting data for car ID: 1980311
2026-03-24 22:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1980311
2026-03-24 22:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf with scrape type 1
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/1.jpg not downloaded yet
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009860d90>
2026-03-24 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/3.jpg saved to cache
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed3310>
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/5.jpg saved to cache
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441ed0>
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/4.jpg saved to cache
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094672d0>
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/7.jpg saved to cache
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009791650>
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/8.jpg saved to cache
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bd050>
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/9.jpg saved to cache
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/2.jpg not downloaded yet
2026-03-24 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/3.jpg not downloaded yet
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/4.jpg not downloaded yet
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/5.jpg not downloaded yet
2026-03-24 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/6.jpg not downloaded yet
2026-03-24 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/7.jpg not downloaded yet
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/8.jpg not downloaded yet
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/9.jpg not downloaded yet
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a4710>
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F8683a2a7d87d40088b1d1a02310f962b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/10.jpg saved to cache
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0475d773-c9bd-57d9-92ba-2afdf730d633
2026-03-24 22:51:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0475d773-c9bd-57d9-92ba-2afdf730d633, skipping ID generation
2026-03-24 22:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0475d773-c9bd-57d9-92ba-2afdf730d633 with scrape type 1
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0475d773-c9bd-57d9-92ba-2afdf730d633 sending to next pipeline
2026-03-24 22:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0475d773-c9bd-57d9-92ba-2afdf730d633, identifier: 1980309
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/10.jpg not downloaded yet
2026-03-24 22:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1980309
2026-03-24 22:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1980309
2026-03-24 22:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1980309 to the API
2026-03-24 22:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0475d773-c9bd-57d9-92ba-2afdf730d633',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 89787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0475d773-c9bd-57d9-92ba-2afdf730d633/0475d773-c9bd-57d9-92ba-2afdf730d633_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/8683a2a7d87d40088b1d1a02310f962b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980309%27 HTTP/1.1" 200 None
2026-03-24 22:51:14 [ayvens.be] INFO: Saving data for 1980309: {'created_time': 1774392674.173605, 'last_price_update_time': 1774392674.173614, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980309') HTTP/1.1" 204 0
2026-03-24 22:51:14 [ayvens.be] INFO: Found listing with ID: 1980312
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980312%27 HTTP/1.1" 200 None
2026-03-24 22:51:14 [ayvens.be] INFO: Scrape type for 1980312: 1
2026-03-24 22:51:14 [ayvens.be] INFO: Extracting data for car ID: 1980312
2026-03-24 22:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1980312
2026-03-24 22:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e9e431-e1c0-5822-8d85-cbcc241018e1 with scrape type 1
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/1.jpg not downloaded yet
2026-03-24 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b710>
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/1.jpg saved to cache
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bf650>
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/2.jpg saved to cache
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6b10>
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/5.jpg saved to cache
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336910>
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/6.jpg saved to cache
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfc510>
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/4.jpg saved to cache
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6b10>
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/7.jpg saved to cache
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946f990>
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/3.jpg saved to cache
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/2.jpg not downloaded yet
2026-03-24 22:51:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/3.jpg not downloaded yet
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008337f10>
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/2.jpg saved to cache
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/4.jpg not downloaded yet
2026-03-24 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/5.jpg not downloaded yet
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/6.jpg not downloaded yet
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096100d0>
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/3.jpg saved to cache
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638a90>
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/1.jpg saved to cache
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c8790>
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/4.jpg saved to cache
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/7.jpg not downloaded yet
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c490>
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/5.jpg saved to cache
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/8.jpg not downloaded yet
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009423f10>
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/10.jpg saved to cache
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0a90>
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/8.jpg saved to cache
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/9.jpg not downloaded yet
2026-03-24 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/10.jpg not downloaded yet
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00919a510>
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cw%252Fbd0ef30aa229405baea860191741b17d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/9.jpg saved to cache
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c32ddf75-f711-5d8e-88f4-e2a8637663cd
2026-03-24 22:51:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c32ddf75-f711-5d8e-88f4-e2a8637663cd, skipping ID generation
2026-03-24 22:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32ddf75-f711-5d8e-88f4-e2a8637663cd with scrape type 1
2026-03-24 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c32ddf75-f711-5d8e-88f4-e2a8637663cd sending to next pipeline
2026-03-24 22:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c32ddf75-f711-5d8e-88f4-e2a8637663cd, identifier: 1980310
2026-03-24 22:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1980310
2026-03-24 22:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1980310
2026-03-24 22:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1980310 to the API
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c32ddf75-f711-5d8e-88f4-e2a8637663cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 144843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 910539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32ddf75-f711-5d8e-88f4-e2a8637663cd/c32ddf75-f711-5d8e-88f4-e2a8637663cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cw/bd0ef30aa229405baea860191741b17d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 530E 170KW XDRIVE AUTO TOURING',
 'transmission': 'automatic',
 'trim': '2.0 530E 170KW XDRIVE AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980310%27 HTTP/1.1" 200 None
2026-03-24 22:51:16 [ayvens.be] INFO: Saving data for 1980310: {'created_time': 1774392676.246764, 'last_price_update_time': 1774392676.246773, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980310') HTTP/1.1" 204 0
2026-03-24 22:51:16 [ayvens.be] INFO: Found listing with ID: 1980313
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980313%27 HTTP/1.1" 200 None
2026-03-24 22:51:16 [ayvens.be] INFO: Scrape type for 1980313: 1
2026-03-24 22:51:16 [ayvens.be] INFO: Extracting data for car ID: 1980313
2026-03-24 22:51:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1980313
2026-03-24 22:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c31d14e-586c-5631-8915-23d5ef030f15 with scrape type 1
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/1.jpg not downloaded yet
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/2.jpg not downloaded yet
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834ec90>
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/8.jpg saved to cache
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c3bd0>
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/10.jpg saved to cache
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009941850>
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/6.jpg saved to cache
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964ef50>
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/9.jpg saved to cache
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009941b10>
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252Facfd018384d547a6849f083965afd06d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/7.jpg saved to cache
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf
2026-03-24 22:51:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c35c4e19-ff8a-52ec-beab-c502dd7d84cf, skipping ID generation
2026-03-24 22:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf with scrape type 1
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf sending to next pipeline
2026-03-24 22:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c35c4e19-ff8a-52ec-beab-c502dd7d84cf, identifier: 1980311
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/3.jpg not downloaded yet
2026-03-24 22:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1980311
2026-03-24 22:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1980311
2026-03-24 22:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1980311 to the API
2026-03-24 22:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c35c4e19-ff8a-52ec-beab-c502dd7d84cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 95935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c35c4e19-ff8a-52ec-beab-c502dd7d84cf/c35c4e19-ff8a-52ec-beab-c502dd7d84cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/acfd018384d547a6849f083965afd06d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma 1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'vin': None,
 'year': 2020}
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980311%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [ayvens.be] INFO: Saving data for 1980311: {'created_time': 1774392677.177089, 'last_price_update_time': 1774392677.177098, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980311') HTTP/1.1" 204 0
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/4.jpg not downloaded yet
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/5.jpg not downloaded yet
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/6.jpg not downloaded yet
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/7.jpg not downloaded yet
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/8.jpg not downloaded yet
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/9.jpg not downloaded yet
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/10.jpg not downloaded yet
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666790>
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/1.jpg saved to cache
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144510>
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/2.jpg saved to cache
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:17 [ayvens.be] INFO: Found listing with ID: 1980314
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980314%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [ayvens.be] INFO: Scrape type for 1980314: 1
2026-03-24 22:51:17 [ayvens.be] INFO: Extracting data for car ID: 1980314
2026-03-24 22:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1980314
2026-03-24 22:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 with scrape type 1
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/1.jpg not downloaded yet
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338150>
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/3.jpg saved to cache
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/2.jpg not downloaded yet
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff017667b90>
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/7.jpg saved to cache
2026-03-24 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009009750>
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/4.jpg saved to cache
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc5250>
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/5.jpg saved to cache
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009146550>
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/8.jpg saved to cache
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008368e10>
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/6.jpg saved to cache
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/3.jpg not downloaded yet
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/4.jpg not downloaded yet
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/5.jpg not downloaded yet
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a94d0>
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/2.jpg saved to cache
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab450>
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/1.jpg saved to cache
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964e2d0>
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/5.jpg saved to cache
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be550>
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/3.jpg saved to cache
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/6.jpg not downloaded yet
2026-03-24 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/7.jpg not downloaded yet
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009185610>
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/4.jpg saved to cache
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/8.jpg not downloaded yet
2026-03-24 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/9.jpg not downloaded yet
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3c90>
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/9.jpg saved to cache
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb450>
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc709f292eef84e1690c51ab7d27336b4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/10.jpg saved to cache
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11e9e431-e1c0-5822-8d85-cbcc241018e1
2026-03-24 22:51:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11e9e431-e1c0-5822-8d85-cbcc241018e1, skipping ID generation
2026-03-24 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e9e431-e1c0-5822-8d85-cbcc241018e1 with scrape type 1
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11e9e431-e1c0-5822-8d85-cbcc241018e1 sending to next pipeline
2026-03-24 22:51:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 11e9e431-e1c0-5822-8d85-cbcc241018e1, identifier: 1980312
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/10.jpg not downloaded yet
2026-03-24 22:51:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1980312
2026-03-24 22:51:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1980312
2026-03-24 22:51:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1980312 to the API
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '11e9e431-e1c0-5822-8d85-cbcc241018e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 128654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e9e431-e1c0-5822-8d85-cbcc241018e1/11e9e431-e1c0-5822-8d85-cbcc241018e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c709f292eef84e1690c51ab7d27336b4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980312%27 HTTP/1.1" 200 None
2026-03-24 22:51:19 [ayvens.be] INFO: Saving data for 1980312: {'created_time': 1774392679.634761, 'last_price_update_time': 1774392679.634771, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980312') HTTP/1.1" 204 0
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cf190>
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/8.jpg saved to cache
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:19 [ayvens.be] INFO: Found listing with ID: 1980315
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980315%27 HTTP/1.1" 200 None
2026-03-24 22:51:19 [ayvens.be] INFO: Scrape type for 1980315: 1
2026-03-24 22:51:19 [ayvens.be] INFO: Extracting data for car ID: 1980315
2026-03-24 22:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1980315
2026-03-24 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1631eb65-126f-594d-a66e-5f4946f4eb27 with scrape type 1
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/1.jpg not downloaded yet
2026-03-24 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/2.jpg not downloaded yet
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009792ed0>
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/7.jpg saved to cache
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cba10>
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/6.jpg saved to cache
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c4650>
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/10.jpg saved to cache
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c7890>
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Fd77f53488e9c44989dae28b4e9aa1b7b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/9.jpg saved to cache
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c31d14e-586c-5631-8915-23d5ef030f15
2026-03-24 22:51:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c31d14e-586c-5631-8915-23d5ef030f15, skipping ID generation
2026-03-24 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c31d14e-586c-5631-8915-23d5ef030f15 with scrape type 1
2026-03-24 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c31d14e-586c-5631-8915-23d5ef030f15 sending to next pipeline
2026-03-24 22:51:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c31d14e-586c-5631-8915-23d5ef030f15, identifier: 1980313
2026-03-24 22:51:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1980313
2026-03-24 22:51:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1980313
2026-03-24 22:51:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1980313 to the API
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3c31d14e-586c-5631-8915-23d5ef030f15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 102982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c31d14e-586c-5631-8915-23d5ef030f15/3c31d14e-586c-5631-8915-23d5ef030f15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/d77f53488e9c44989dae28b4e9aa1b7b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E XDRIVE TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E XDRIVE TOURING',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980313%27 HTTP/1.1" 200 None
2026-03-24 22:51:20 [ayvens.be] INFO: Saving data for 1980313: {'created_time': 1774392680.385102, 'last_price_update_time': 1774392680.385114, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980313') HTTP/1.1" 204 0
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/3.jpg not downloaded yet
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/4.jpg not downloaded yet
2026-03-24 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf4c90>
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/1.jpg saved to cache
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/5.jpg not downloaded yet
2026-03-24 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/6.jpg not downloaded yet
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/7.jpg not downloaded yet
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/8.jpg not downloaded yet
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912bc50>
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/2.jpg saved to cache
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091420d0>
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/7.jpg saved to cache
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/9.jpg not downloaded yet
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/10.jpg not downloaded yet
2026-03-24 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097aaed0>
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/3.jpg saved to cache
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009870ad0>
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/4.jpg saved to cache
2026-03-24 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838d110>
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/5.jpg saved to cache
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008383e10>
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/6.jpg saved to cache
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009147450>
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/8.jpg saved to cache
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:21 [ayvens.be] INFO: Found listing with ID: 1980316
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980316%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [ayvens.be] INFO: Scrape type for 1980316: 1
2026-03-24 22:51:21 [ayvens.be] INFO: Extracting data for car ID: 1980316
2026-03-24 22:51:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1980316
2026-03-24 22:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with scrape type 1
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/1.jpg not downloaded yet
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/2.jpg not downloaded yet
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/3.jpg not downloaded yet
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d310>
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/9.jpg saved to cache
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/4.jpg not downloaded yet
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/5.jpg not downloaded yet
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/6.jpg not downloaded yet
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/7.jpg not downloaded yet
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/8.jpg not downloaded yet
2026-03-24 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/9.jpg not downloaded yet
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/10.jpg not downloaded yet
2026-03-24 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834f750>
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/1.jpg saved to cache
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145cd0>
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F4b01fc9136834e9099c59ed10a9fc7ee%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/10.jpg saved to cache
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1077883c-b0c1-5767-992f-d0213ab4e1c7
2026-03-24 22:51:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1077883c-b0c1-5767-992f-d0213ab4e1c7, skipping ID generation
2026-03-24 22:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 with scrape type 1
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 sending to next pipeline
2026-03-24 22:51:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1077883c-b0c1-5767-992f-d0213ab4e1c7, identifier: 1980314
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b92d0>
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/4.jpg saved to cache
2026-03-24 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb810>
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/3.jpg saved to cache
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836a250>
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/2.jpg saved to cache
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:22 [ayvens.be] INFO: Found listing with ID: 1980317
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980317%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [ayvens.be] INFO: Scrape type for 1980317: 1
2026-03-24 22:51:22 [ayvens.be] INFO: Extracting data for car ID: 1980317
2026-03-24 22:51:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1980317
2026-03-24 22:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with scrape type 1
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/1.jpg not downloaded yet
2026-03-24 22:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1980314
2026-03-24 22:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1980314
2026-03-24 22:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1980314 to the API
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1077883c-b0c1-5767-992f-d0213ab4e1c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 64116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1077883c-b0c1-5767-992f-d0213ab4e1c7/1077883c-b0c1-5767-992f-d0213ab4e1c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/4b01fc9136834e9099c59ed10a9fc7ee/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980314%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [ayvens.be] INFO: Saving data for 1980314: {'created_time': 1774392682.460762, 'last_price_update_time': 1774392682.460771, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980314') HTTP/1.1" 204 0
2026-03-24 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/2.jpg not downloaded yet
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/3.jpg not downloaded yet
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098624d0>
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/7.jpg saved to cache
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962a750>
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/9.jpg saved to cache
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/4.jpg not downloaded yet
2026-03-24 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/5.jpg not downloaded yet
2026-03-24 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfca10>
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/8.jpg saved to cache
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/6.jpg not downloaded yet
2026-03-24 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/7.jpg not downloaded yet
2026-03-24 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/8.jpg not downloaded yet
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bfbe310>
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/6.jpg saved to cache
2026-03-24 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834c490>
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/5.jpg saved to cache
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8910>
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1uq%252Fc1015b4087c94b378cf8b8de856bc5a8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/10.jpg saved to cache
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1631eb65-126f-594d-a66e-5f4946f4eb27
2026-03-24 22:51:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1631eb65-126f-594d-a66e-5f4946f4eb27, skipping ID generation
2026-03-24 22:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1631eb65-126f-594d-a66e-5f4946f4eb27 with scrape type 1
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1631eb65-126f-594d-a66e-5f4946f4eb27 sending to next pipeline
2026-03-24 22:51:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1631eb65-126f-594d-a66e-5f4946f4eb27, identifier: 1980315
2026-03-24 22:51:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1980315
2026-03-24 22:51:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1980315
2026-03-24 22:51:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1980315 to the API
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '1631eb65-126f-594d-a66e-5f4946f4eb27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 40862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 928358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 889311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1631eb65-126f-594d-a66e-5f4946f4eb27/1631eb65-126f-594d-a66e-5f4946f4eb27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 924101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1uq/c1015b4087c94b378cf8b8de856bc5a8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2018}
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980315%27 HTTP/1.1" 200 None
2026-03-24 22:51:23 [ayvens.be] INFO: Saving data for 1980315: {'created_time': 1774392683.54334, 'last_price_update_time': 1774392683.54335, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980315') HTTP/1.1" 204 0
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/9.jpg not downloaded yet
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018890>
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/1.jpg saved to cache
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975a9d0>
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/2.jpg saved to cache
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/10.jpg not downloaded yet
2026-03-24 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093db410>
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/3.jpg saved to cache
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c7b10>
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/4.jpg saved to cache
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:23 [ayvens.be] INFO: Found listing with ID: 1980318
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980318%27 HTTP/1.1" 200 None
2026-03-24 22:51:23 [ayvens.be] INFO: Scrape type for 1980318: 1
2026-03-24 22:51:23 [ayvens.be] INFO: Extracting data for car ID: 1980318
2026-03-24 22:51:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1980318
2026-03-24 22:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with scrape type 1
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/1.jpg not downloaded yet
2026-03-24 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/2.jpg not downloaded yet
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009789e50>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/5.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872510>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/1.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/3.jpg not downloaded yet
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/4.jpg not downloaded yet
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110f10>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/2.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128990>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/7.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/5.jpg not downloaded yet
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/6.jpg not downloaded yet
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/7.jpg not downloaded yet
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb0210>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/6.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964f790>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/10.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964cd50>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/9.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685310>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/3.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c790>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/4.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/8.jpg not downloaded yet
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/9.jpg not downloaded yet
2026-03-24 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf60d0>
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F4fab73a4c1b1486bbd0546770f32f661%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/8.jpg saved to cache
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789
2026-03-24 22:51:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d21a3c6-1f65-5cd1-b250-9745fef5b789, skipping ID generation
2026-03-24 22:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with scrape type 1
2026-03-24 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789 sending to next pipeline
2026-03-24 22:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4d21a3c6-1f65-5cd1-b250-9745fef5b789, identifier: 1980316
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b27c110>
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/6.jpg saved to cache
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/10.jpg not downloaded yet
2026-03-24 22:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1980316
2026-03-24 22:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1980316
2026-03-24 22:51:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1980316 to the API
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4d21a3c6-1f65-5cd1-b250-9745fef5b789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 192617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 865804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d21a3c6-1f65-5cd1-b250-9745fef5b789/4d21a3c6-1f65-5cd1-b250-9745fef5b789_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/4fab73a4c1b1486bbd0546770f32f661/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980316%27 HTTP/1.1" 200 None
2026-03-24 22:51:25 [ayvens.be] INFO: Saving data for 1980316: {'created_time': 1774392685.498003, 'last_price_update_time': 1774392685.498012, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980316') HTTP/1.1" 204 0
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c28d0>
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/8.jpg saved to cache
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:25 [ayvens.be] INFO: Found listing with ID: 1980319
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980319%27 HTTP/1.1" 200 None
2026-03-24 22:51:25 [ayvens.be] INFO: Scrape type for 1980319: 1
2026-03-24 22:51:25 [ayvens.be] INFO: Extracting data for car ID: 1980319
2026-03-24 22:51:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1980319
2026-03-24 22:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c2d1c4-9322-5908-a639-1d2425340280 with scrape type 1
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/1.jpg not downloaded yet
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/2.jpg not downloaded yet
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2a50>
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/7.jpg saved to cache
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913f290>
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/10.jpg saved to cache
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944a890>
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/9.jpg saved to cache
2026-03-24 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/3.jpg not downloaded yet
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/4.jpg not downloaded yet
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/5.jpg not downloaded yet
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/6.jpg not downloaded yet
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/7.jpg not downloaded yet
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/8.jpg not downloaded yet
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/9.jpg not downloaded yet
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1a8cd0>
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/1.jpg saved to cache
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bfa50>
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/2.jpg saved to cache
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/10.jpg not downloaded yet
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347790>
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/3.jpg saved to cache
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [ayvens.be] INFO: Found listing with ID: 1980320
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980320%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [ayvens.be] INFO: Scrape type for 1980320: 1
2026-03-24 22:51:26 [ayvens.be] INFO: Extracting data for car ID: 1980320
2026-03-24 22:51:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1980320
2026-03-24 22:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ac458c-7145-517c-9805-468b8545bc8f with scrape type 1
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/1.jpg not downloaded yet
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/2.jpg not downloaded yet
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094645d0>
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/4.jpg saved to cache
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b19d0>
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/6.jpg saved to cache
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473c10>
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/5.jpg saved to cache
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f82d0>
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/7.jpg saved to cache
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/3.jpg not downloaded yet
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/4.jpg not downloaded yet
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb2850>
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/9.jpg saved to cache
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/5.jpg not downloaded yet
2026-03-24 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/6.jpg not downloaded yet
2026-03-24 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/7.jpg not downloaded yet
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187a50>
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/10.jpg saved to cache
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097aba10>
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/2.jpg saved to cache
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946df10>
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/1.jpg saved to cache
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946df50>
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/4.jpg saved to cache
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009565a50>
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/3.jpg saved to cache
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/8.jpg not downloaded yet
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/9.jpg not downloaded yet
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964e8d0>
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ak%252Fb447bfa205a448c1971395f54b3c5f7d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/8.jpg saved to cache
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb
2026-03-24 22:51:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb, skipping ID generation
2026-03-24 22:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with scrape type 1
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb sending to next pipeline
2026-03-24 22:51:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb, identifier: 1980318
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab5d0>
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/5.jpg saved to cache
2026-03-24 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/10.jpg not downloaded yet
2026-03-24 22:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1980318
2026-03-24 22:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1980318
2026-03-24 22:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1980318 to the API
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '27122ce6-6efb-57c3-8ae6-24b13bc4abdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 81085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27122ce6-6efb-57c3-8ae6-24b13bc4abdb/27122ce6-6efb-57c3-8ae6-24b13bc4abdb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ak/b447bfa205a448c1971395f54b3c5f7d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980318%27 HTTP/1.1" 200 None
2026-03-24 22:51:28 [ayvens.be] INFO: Saving data for 1980318: {'created_time': 1774392688.318922, 'last_price_update_time': 1774392688.318932, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980318') HTTP/1.1" 204 0
2026-03-24 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:28 [ayvens.be] INFO: Found listing with ID: 1980321
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980321%27 HTTP/1.1" 200 None
2026-03-24 22:51:28 [ayvens.be] INFO: Scrape type for 1980321: 1
2026-03-24 22:51:28 [ayvens.be] INFO: Extracting data for car ID: 1980321
2026-03-24 22:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1980321
2026-03-24 22:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fee27e6-61f1-5f95-91d9-a32647513628 with scrape type 1
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/1.jpg not downloaded yet
2026-03-24 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/2.jpg not downloaded yet
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b62ad0>
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/8.jpg saved to cache
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/3.jpg not downloaded yet
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/4.jpg not downloaded yet
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c9110>
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/6.jpg saved to cache
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112690>
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/7.jpg saved to cache
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c5710>
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/10.jpg saved to cache
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963a990>
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/1.jpg saved to cache
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/5.jpg not downloaded yet
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336210>
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dh%252Fcecac8747fc34f19b9415f3c6ad59354%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/9.jpg saved to cache
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2c2d1c4-9322-5908-a639-1d2425340280
2026-03-24 22:51:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2c2d1c4-9322-5908-a639-1d2425340280, skipping ID generation
2026-03-24 22:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c2d1c4-9322-5908-a639-1d2425340280 with scrape type 1
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2c2d1c4-9322-5908-a639-1d2425340280 sending to next pipeline
2026-03-24 22:51:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b2c2d1c4-9322-5908-a639-1d2425340280, identifier: 1980319
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091766d0>
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/2.jpg saved to cache
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/6.jpg not downloaded yet
2026-03-24 22:51:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1980319
2026-03-24 22:51:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1980319
2026-03-24 22:51:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1980319 to the API
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b2c2d1c4-9322-5908-a639-1d2425340280',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 120060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c2d1c4-9322-5908-a639-1d2425340280/b2c2d1c4-9322-5908-a639-1d2425340280_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dh/cecac8747fc34f19b9415f3c6ad59354/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '2.0 GLB 200 D LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980319%27 HTTP/1.1" 200 None
2026-03-24 22:51:29 [ayvens.be] INFO: Saving data for 1980319: {'created_time': 1774392689.540355, 'last_price_update_time': 1774392689.540365, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980319') HTTP/1.1" 204 0
2026-03-24 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/7.jpg not downloaded yet
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/8.jpg not downloaded yet
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/9.jpg not downloaded yet
2026-03-24 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/10.jpg not downloaded yet
2026-03-24 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:29 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-24 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6cea90>
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/4.jpg saved to cache
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009771990>
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/5.jpg saved to cache
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b7ce7d0>
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/3.jpg saved to cache
2026-03-24 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145190>
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/7.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963b8d0>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/8.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0090121d0>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/6.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be890>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/9.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc6950>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/2.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c65d0>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/1.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093978d0>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/6.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1a8950>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/4.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912a790>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/5.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a29d0>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/3.jpg saved to cache
2026-03-24 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610a10>
2026-03-24 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F980bb928f5de4cde9bb30668ebbdd069%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/10.jpg saved to cache
2026-03-24 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7ac458c-7145-517c-9805-468b8545bc8f
2026-03-24 22:51:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7ac458c-7145-517c-9805-468b8545bc8f, skipping ID generation
2026-03-24 22:51:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ac458c-7145-517c-9805-468b8545bc8f with scrape type 1
2026-03-24 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7ac458c-7145-517c-9805-468b8545bc8f sending to next pipeline
2026-03-24 22:51:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7ac458c-7145-517c-9805-468b8545bc8f, identifier: 1980320
2026-03-24 22:51:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1980320
2026-03-24 22:51:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1980320
2026-03-24 22:51:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1980320 to the API
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e7ac458c-7145-517c-9805-468b8545bc8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 131721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 932857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ac458c-7145-517c-9805-468b8545bc8f/e7ac458c-7145-517c-9805-468b8545bc8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 919739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/980bb928f5de4cde9bb30668ebbdd069/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW ST-LINE AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW ST-LINE AUTO',
 'vin': None,
 'year': 2023}
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980320%27 HTTP/1.1" 200 None
2026-03-24 22:51:31 [ayvens.be] INFO: Saving data for 1980320: {'created_time': 1774392691.784624, 'last_price_update_time': 1774392691.784635, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980320') HTTP/1.1" 204 0
2026-03-24 22:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009617f10>
2026-03-24 22:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/9.jpg saved to cache
2026-03-24 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2490>
2026-03-24 22:51:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/8.jpg saved to cache
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836ac90>
2026-03-24 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/7.jpg saved to cache
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009615f90>
2026-03-24 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F9c9d35ffc3b44486ba60917d9efd36c4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/10.jpg saved to cache
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fee27e6-61f1-5f95-91d9-a32647513628
2026-03-24 22:51:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fee27e6-61f1-5f95-91d9-a32647513628, skipping ID generation
2026-03-24 22:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fee27e6-61f1-5f95-91d9-a32647513628 with scrape type 1
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fee27e6-61f1-5f95-91d9-a32647513628 sending to next pipeline
2026-03-24 22:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3fee27e6-61f1-5f95-91d9-a32647513628, identifier: 1980321
2026-03-24 22:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1980321
2026-03-24 22:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1980321
2026-03-24 22:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1980321 to the API
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '3fee27e6-61f1-5f95-91d9-a32647513628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 156563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 885978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee27e6-61f1-5f95-91d9-a32647513628/3fee27e6-61f1-5f95-91d9-a32647513628_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/9c9d35ffc3b44486ba60917d9efd36c4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980321%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [ayvens.be] INFO: Saving data for 1980321: {'created_time': 1774392692.661417, 'last_price_update_time': 1774392692.661426, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980321') HTTP/1.1" 204 0
2026-03-24 22:51:32 [ayvens.be] INFO: Found listing with ID: 1980322
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980322%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [ayvens.be] INFO: Scrape type for 1980322: 1
2026-03-24 22:51:32 [ayvens.be] INFO: Extracting data for car ID: 1980322
2026-03-24 22:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1980322
2026-03-24 22:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477eb99e-c090-55db-89eb-5a7bf472e898 with scrape type 1
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/1.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/2.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/3.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/4.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/5.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/6.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/7.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/8.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/9.jpg not downloaded yet
2026-03-24 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/10.jpg not downloaded yet
2026-03-24 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:32 [ayvens.be] INFO: Found listing with ID: 1980323
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980323%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [ayvens.be] INFO: Scrape type for 1980323: 1
2026-03-24 22:51:32 [ayvens.be] INFO: Extracting data for car ID: 1980323
2026-03-24 22:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1980323
2026-03-24 22:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586037ca-bf37-5f2f-8942-f775bf132317 with scrape type 1
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/1.jpg not downloaded yet
2026-03-24 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/2.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/3.jpg not downloaded yet
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/4.jpg not downloaded yet
2026-03-24 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/5.jpg not downloaded yet
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009793790>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/1.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/6.jpg not downloaded yet
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf72d0>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/2.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/7.jpg not downloaded yet
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095aab50>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/3.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/8.jpg not downloaded yet
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493610>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/6.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334510>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/5.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967c690>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/7.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009789a10>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/8.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/9.jpg not downloaded yet
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018d50>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/4.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/10.jpg not downloaded yet
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [ayvens.be] INFO: Found listing with ID: 1980324
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980324%27 HTTP/1.1" 200 None
2026-03-24 22:51:33 [ayvens.be] INFO: Scrape type for 1980324: 1
2026-03-24 22:51:33 [ayvens.be] INFO: Extracting data for car ID: 1980324
2026-03-24 22:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1980324
2026-03-24 22:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15129c96-225f-52ab-943d-69e5fbd62080 with scrape type 1
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/1.jpg not downloaded yet
2026-03-24 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009141010>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/9.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b656e90>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/1.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009863cd0>
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/2.jpg saved to cache
2026-03-24 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/2.jpg not downloaded yet
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009420ed0>
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F650a84aae149459ebaa1561f40115463%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/10.jpg saved to cache
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 477eb99e-c090-55db-89eb-5a7bf472e898
2026-03-24 22:51:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 477eb99e-c090-55db-89eb-5a7bf472e898, skipping ID generation
2026-03-24 22:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477eb99e-c090-55db-89eb-5a7bf472e898 with scrape type 1
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 477eb99e-c090-55db-89eb-5a7bf472e898 sending to next pipeline
2026-03-24 22:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 477eb99e-c090-55db-89eb-5a7bf472e898, identifier: 1980322
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/3.jpg not downloaded yet
2026-03-24 22:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1980322
2026-03-24 22:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1980322
2026-03-24 22:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1980322 to the API
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '477eb99e-c090-55db-89eb-5a7bf472e898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 46187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477eb99e-c090-55db-89eb-5a7bf472e898/477eb99e-c090-55db-89eb-5a7bf472e898_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/650a84aae149459ebaa1561f40115463/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980322%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [ayvens.be] INFO: Saving data for 1980322: {'created_time': 1774392694.617107, 'last_price_update_time': 1774392694.617117, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980322') HTTP/1.1" 204 0
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8890>
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/3.jpg saved to cache
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a30d0>
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/5.jpg saved to cache
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018ed0>
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/4.jpg saved to cache
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/4.jpg not downloaded yet
2026-03-24 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/5.jpg not downloaded yet
2026-03-24 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/6.jpg not downloaded yet
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/7.jpg not downloaded yet
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/8.jpg not downloaded yet
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/9.jpg not downloaded yet
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/10.jpg not downloaded yet
2026-03-24 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:34 [ayvens.be] INFO: Found listing with ID: 1980325
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980325%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [ayvens.be] INFO: Scrape type for 1980325: 1
2026-03-24 22:51:34 [ayvens.be] INFO: Extracting data for car ID: 1980325
2026-03-24 22:51:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1980325
2026-03-24 22:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a931999a-c1a0-5ac7-a643-391330f16773 with scrape type 1
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/1.jpg not downloaded yet
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871990>
2026-03-24 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/7.jpg saved to cache
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b9190>
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/8.jpg saved to cache
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473e50>
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/9.jpg saved to cache
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/2.jpg not downloaded yet
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946d290>
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/6.jpg saved to cache
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009943f90>
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1a55e38c64854187948991e30d78cafd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/10.jpg saved to cache
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 586037ca-bf37-5f2f-8942-f775bf132317
2026-03-24 22:51:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 586037ca-bf37-5f2f-8942-f775bf132317, skipping ID generation
2026-03-24 22:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586037ca-bf37-5f2f-8942-f775bf132317 with scrape type 1
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 586037ca-bf37-5f2f-8942-f775bf132317 sending to next pipeline
2026-03-24 22:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 586037ca-bf37-5f2f-8942-f775bf132317, identifier: 1980323
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf6e50>
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/1.jpg saved to cache
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/3.jpg not downloaded yet
2026-03-24 22:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1980323
2026-03-24 22:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1980323
2026-03-24 22:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1980323 to the API
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '586037ca-bf37-5f2f-8942-f775bf132317',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 GRAN TOURER DIESEL - 2018',
 'odometer': 75116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586037ca-bf37-5f2f-8942-f775bf132317/586037ca-bf37-5f2f-8942-f775bf132317_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1a55e38c64854187948991e30d78cafd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 GRAN TOURER DIESEL - 2018 216 d AdBlue',
 'transmission': 'manual',
 'trim': '216 d AdBlue',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980323%27 HTTP/1.1" 200 None
2026-03-24 22:51:35 [ayvens.be] INFO: Saving data for 1980323: {'created_time': 1774392695.833418, 'last_price_update_time': 1774392695.833427, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980323') HTTP/1.1" 204 0
2026-03-24 22:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/4.jpg not downloaded yet
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772750>
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/2.jpg saved to cache
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096299d0>
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/4.jpg saved to cache
2026-03-24 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008371d50>
2026-03-24 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/3.jpg saved to cache
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/5.jpg not downloaded yet
2026-03-24 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009686e10>
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/5.jpg saved to cache
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d6ad0>
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/6.jpg saved to cache
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095eea90>
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/9.jpg saved to cache
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/6.jpg not downloaded yet
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/7.jpg not downloaded yet
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009567910>
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/7.jpg saved to cache
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cbe10>
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/8.jpg saved to cache
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009143c50>
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F4ebe1f27e4284d28a4c3393a49e87a9e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/10.jpg saved to cache
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15129c96-225f-52ab-943d-69e5fbd62080
2026-03-24 22:51:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15129c96-225f-52ab-943d-69e5fbd62080, skipping ID generation
2026-03-24 22:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15129c96-225f-52ab-943d-69e5fbd62080 with scrape type 1
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15129c96-225f-52ab-943d-69e5fbd62080 sending to next pipeline
2026-03-24 22:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 15129c96-225f-52ab-943d-69e5fbd62080, identifier: 1980324
2026-03-24 22:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1980324
2026-03-24 22:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1980324
2026-03-24 22:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1980324 to the API
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '15129c96-225f-52ab-943d-69e5fbd62080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW DIESEL - 2018',
 'odometer': 72664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15129c96-225f-52ab-943d-69e5fbd62080/15129c96-225f-52ab-943d-69e5fbd62080_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/4ebe1f27e4284d28a4c3393a49e87a9e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW DIESEL - 2018 1.5 BlueHDi Active S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active S&S',
 'vin': None,
 'year': 2020}
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980324%27 HTTP/1.1" 200 None
2026-03-24 22:51:36 [ayvens.be] INFO: Saving data for 1980324: {'created_time': 1774392696.892223, 'last_price_update_time': 1774392696.892234, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980324') HTTP/1.1" 204 0
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/8.jpg not downloaded yet
2026-03-24 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/9.jpg not downloaded yet
2026-03-24 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/10.jpg not downloaded yet
2026-03-24 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:36 [ayvens.be] INFO: Found listing with ID: 1980326
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980326%27 HTTP/1.1" 200 None
2026-03-24 22:51:36 [ayvens.be] INFO: Scrape type for 1980326: 1
2026-03-24 22:51:36 [ayvens.be] INFO: Extracting data for car ID: 1980326
2026-03-24 22:51:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1980326
2026-03-24 22:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694c3744-9423-597e-8981-51fdfba093c6 with scrape type 1
2026-03-24 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/1.jpg not downloaded yet
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/2.jpg not downloaded yet
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/3.jpg not downloaded yet
2026-03-24 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/4.jpg not downloaded yet
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095abb10>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/1.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/5.jpg not downloaded yet
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407cd0>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/5.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7110>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/2.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1250>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/3.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/6.jpg not downloaded yet
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aecf750>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/4.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/7.jpg not downloaded yet
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083152d0>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/6.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095edd90>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/8.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bf210>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/7.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/8.jpg not downloaded yet
2026-03-24 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/9.jpg not downloaded yet
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8f50>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/10.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd050>
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F6e5ffd753f1a4685876e3cf10650fb03%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/9.jpg saved to cache
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a931999a-c1a0-5ac7-a643-391330f16773
2026-03-24 22:51:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a931999a-c1a0-5ac7-a643-391330f16773, skipping ID generation
2026-03-24 22:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a931999a-c1a0-5ac7-a643-391330f16773 with scrape type 1
2026-03-24 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a931999a-c1a0-5ac7-a643-391330f16773 sending to next pipeline
2026-03-24 22:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a931999a-c1a0-5ac7-a643-391330f16773, identifier: 1980325
2026-03-24 22:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1980325
2026-03-24 22:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1980325
2026-03-24 22:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1980325 to the API
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a931999a-c1a0-5ac7-a643-391330f16773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 60665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a931999a-c1a0-5ac7-a643-391330f16773/a931999a-c1a0-5ac7-a643-391330f16773_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/6e5ffd753f1a4685876e3cf10650fb03/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BEV 50KWH ELECT. E-208 AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH ELECT. E-208 AUTO ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980325%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [ayvens.be] INFO: Saving data for 1980325: {'created_time': 1774392698.432893, 'last_price_update_time': 1774392698.432902, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980325') HTTP/1.1" 204 0
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/10.jpg not downloaded yet
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009470e10>
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/2.jpg saved to cache
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:38 [ayvens.be] INFO: Found listing with ID: 1980327
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980327%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [ayvens.be] INFO: Scrape type for 1980327: 1
2026-03-24 22:51:38 [ayvens.be] INFO: Extracting data for car ID: 1980327
2026-03-24 22:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1980327
2026-03-24 22:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbac0540-39df-5073-9762-7f74f4e38c3a with scrape type 1
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/1.jpg not downloaded yet
2026-03-24 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/2.jpg not downloaded yet
2026-03-24 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/3.jpg not downloaded yet
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/4.jpg not downloaded yet
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/5.jpg not downloaded yet
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009423290>
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/1.jpg saved to cache
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009404510>
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/5.jpg saved to cache
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/6.jpg not downloaded yet
2026-03-24 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/7.jpg not downloaded yet
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962d610>
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/3.jpg saved to cache
2026-03-24 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00be67750>
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/4.jpg saved to cache
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394510>
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/6.jpg saved to cache
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009863b50>
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/7.jpg saved to cache
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/8.jpg not downloaded yet
2026-03-24 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b4ed0>
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/8.jpg saved to cache
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095a9250>
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/10.jpg saved to cache
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/9.jpg not downloaded yet
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/10.jpg not downloaded yet
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144790>
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Febce0c51b45d4a6799dc3005978fcdc4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/9.jpg saved to cache
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 694c3744-9423-597e-8981-51fdfba093c6
2026-03-24 22:51:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 694c3744-9423-597e-8981-51fdfba093c6, skipping ID generation
2026-03-24 22:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694c3744-9423-597e-8981-51fdfba093c6 with scrape type 1
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 694c3744-9423-597e-8981-51fdfba093c6 sending to next pipeline
2026-03-24 22:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 694c3744-9423-597e-8981-51fdfba093c6, identifier: 1980326
2026-03-24 22:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1980326
2026-03-24 22:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1980326
2026-03-24 22:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1980326 to the API
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '694c3744-9423-597e-8981-51fdfba093c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 98842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694c3744-9423-597e-8981-51fdfba093c6/694c3744-9423-597e-8981-51fdfba093c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/ebce0c51b45d4a6799dc3005978fcdc4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma 1.5 TDCI 88KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 TDCI 88KW TITANIUM',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980326%27 HTTP/1.1" 200 None
2026-03-24 22:51:39 [ayvens.be] INFO: Saving data for 1980326: {'created_time': 1774392699.875392, 'last_price_update_time': 1774392699.875404, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980326') HTTP/1.1" 204 0
2026-03-24 22:51:39 [ayvens.be] INFO: Found listing with ID: 1980328
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980328%27 HTTP/1.1" 200 None
2026-03-24 22:51:39 [ayvens.be] INFO: Scrape type for 1980328: 1
2026-03-24 22:51:39 [ayvens.be] INFO: Extracting data for car ID: 1980328
2026-03-24 22:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1980328
2026-03-24 22:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with scrape type 1
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/1.jpg not downloaded yet
2026-03-24 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/2.jpg not downloaded yet
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/3.jpg not downloaded yet
2026-03-24 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/4.jpg not downloaded yet
2026-03-24 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/5.jpg not downloaded yet
2026-03-24 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/6.jpg not downloaded yet
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/7.jpg not downloaded yet
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/8.jpg not downloaded yet
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c090>
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/1.jpg saved to cache
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009862e10>
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/2.jpg saved to cache
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f3990>
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/3.jpg saved to cache
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/9.jpg not downloaded yet
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372810>
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/4.jpg saved to cache
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/10.jpg not downloaded yet
2026-03-24 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:40 [ayvens.be] INFO: Found listing with ID: 1980329
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980329%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [ayvens.be] INFO: Scrape type for 1980329: 1
2026-03-24 22:51:40 [ayvens.be] INFO: Extracting data for car ID: 1980329
2026-03-24 22:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1980329
2026-03-24 22:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0df3679-6c69-53f3-837f-08eaed75cc34 with scrape type 1
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/1.jpg not downloaded yet
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed1350>
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/5.jpg saved to cache
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407890>
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/6.jpg saved to cache
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed3010>
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/7.jpg saved to cache
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/2.jpg not downloaded yet
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/3.jpg not downloaded yet
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3a90>
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/8.jpg saved to cache
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/4.jpg not downloaded yet
2026-03-24 22:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/5.jpg not downloaded yet
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/6.jpg not downloaded yet
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009122290>
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/10.jpg saved to cache
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/7.jpg not downloaded yet
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/8.jpg not downloaded yet
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347e90>
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F41c8b6eb5aa94260a1a6aeaccc22f95c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/9.jpg saved to cache
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbac0540-39df-5073-9762-7f74f4e38c3a
2026-03-24 22:51:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbac0540-39df-5073-9762-7f74f4e38c3a, skipping ID generation
2026-03-24 22:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbac0540-39df-5073-9762-7f74f4e38c3a with scrape type 1
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbac0540-39df-5073-9762-7f74f4e38c3a sending to next pipeline
2026-03-24 22:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dbac0540-39df-5073-9762-7f74f4e38c3a, identifier: 1980327
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093bbd90>
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/1.jpg saved to cache
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838ee50>
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/2.jpg saved to cache
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a9d90>
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/3.jpg saved to cache
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a2e90>
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/4.jpg saved to cache
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/9.jpg not downloaded yet
2026-03-24 22:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1980327
2026-03-24 22:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1980327
2026-03-24 22:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1980327 to the API
2026-03-24 22:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dbac0540-39df-5073-9762-7f74f4e38c3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 183362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 856536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 891085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbac0540-39df-5073-9762-7f74f4e38c3a/dbac0540-39df-5073-9762-7f74f4e38c3a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/41c8b6eb5aa94260a1a6aeaccc22f95c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 1.0 30 TFSI ATTRACTION',
 'transmission': 'manual',
 'trim': '1.0 30 TFSI ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980327%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [ayvens.be] INFO: Saving data for 1980327: {'created_time': 1774392702.16534, 'last_price_update_time': 1774392702.165349, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980327') HTTP/1.1" 204 0
2026-03-24 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/10.jpg not downloaded yet
2026-03-24 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:42 [ayvens.be] INFO: Found listing with ID: 1980330
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980330%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [ayvens.be] INFO: Scrape type for 1980330: 1
2026-03-24 22:51:42 [ayvens.be] INFO: Extracting data for car ID: 1980330
2026-03-24 22:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1980330
2026-03-24 22:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7e5240-8a65-5e03-80d9-ed222dac75cd with scrape type 1
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/1.jpg not downloaded yet
2026-03-24 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/2.jpg not downloaded yet
2026-03-24 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/3.jpg not downloaded yet
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/4.jpg not downloaded yet
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0090116d0>
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/8.jpg saved to cache
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/5.jpg not downloaded yet
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b9910>
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/9.jpg saved to cache
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/6.jpg not downloaded yet
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/7.jpg not downloaded yet
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b78c90>
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/7.jpg saved to cache
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b1750>
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/1.jpg saved to cache
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1ba510>
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/10.jpg saved to cache
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c8090>
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/5.jpg saved to cache
2026-03-24 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009567d50>
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F03ffbdc23bb94efeb6e4cf2cde0fbe7d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/6.jpg saved to cache
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c
2026-03-24 22:51:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c, skipping ID generation
2026-03-24 22:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with scrape type 1
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c sending to next pipeline
2026-03-24 22:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c, identifier: 1980328
2026-03-24 22:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1980328
2026-03-24 22:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1980328
2026-03-24 22:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1980328 to the API
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '96fdc9f1-7ce0-5fb1-a642-99698f01a88c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 172566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96fdc9f1-7ce0-5fb1-a642-99698f01a88c/96fdc9f1-7ce0-5fb1-a642-99698f01a88c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/03ffbdc23bb94efeb6e4cf2cde0fbe7d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980328%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [ayvens.be] INFO: Saving data for 1980328: {'created_time': 1774392703.432802, 'last_price_update_time': 1774392703.432812, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980328') HTTP/1.1" 204 0
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/8.jpg not downloaded yet
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/9.jpg not downloaded yet
2026-03-24 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/10.jpg not downloaded yet
2026-03-24 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:43 [ayvens.be] INFO: Found listing with ID: 1980331
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980331%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [ayvens.be] INFO: Scrape type for 1980331: 1
2026-03-24 22:51:43 [ayvens.be] INFO: Extracting data for car ID: 1980331
2026-03-24 22:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1980331
2026-03-24 22:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 054bf54d-3f34-5d87-91cc-317a6a689a28 with scrape type 1
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/1.jpg not downloaded yet
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/2.jpg not downloaded yet
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/3.jpg not downloaded yet
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/4.jpg not downloaded yet
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/5.jpg not downloaded yet
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c0e90>
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/2.jpg saved to cache
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb710>
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/4.jpg saved to cache
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098705d0>
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/5.jpg saved to cache
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c8410>
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/3.jpg saved to cache
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c2810>
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/7.jpg saved to cache
2026-03-24 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/6.jpg not downloaded yet
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760610>
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/8.jpg saved to cache
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962e290>
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/6.jpg saved to cache
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/7.jpg not downloaded yet
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/8.jpg not downloaded yet
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964c590>
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/3.jpg saved to cache
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c2e90>
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/4.jpg saved to cache
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e1490>
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/2.jpg saved to cache
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/9.jpg not downloaded yet
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/10.jpg not downloaded yet
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334790>
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/9.jpg saved to cache
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096402d0>
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/1.jpg saved to cache
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bcd50>
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbc23e376c15845af9794a11c670f7a66%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/10.jpg saved to cache
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0df3679-6c69-53f3-837f-08eaed75cc34
2026-03-24 22:51:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0df3679-6c69-53f3-837f-08eaed75cc34, skipping ID generation
2026-03-24 22:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0df3679-6c69-53f3-837f-08eaed75cc34 with scrape type 1
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0df3679-6c69-53f3-837f-08eaed75cc34 sending to next pipeline
2026-03-24 22:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a0df3679-6c69-53f3-837f-08eaed75cc34, identifier: 1980329
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f6f90>
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/5.jpg saved to cache
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:44 [ayvens.be] INFO: Found listing with ID: 1980332
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980332%27 HTTP/1.1" 200 None
2026-03-24 22:51:44 [ayvens.be] INFO: Scrape type for 1980332: 1
2026-03-24 22:51:44 [ayvens.be] INFO: Extracting data for car ID: 1980332
2026-03-24 22:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1980332
2026-03-24 22:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81745107-cd5b-55d7-b04b-60f6322262e6 with scrape type 1
2026-03-24 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/1.jpg not downloaded yet
2026-03-24 22:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1980329
2026-03-24 22:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1980329
2026-03-24 22:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1980329 to the API
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a0df3679-6c69-53f3-837f-08eaed75cc34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 70710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0df3679-6c69-53f3-837f-08eaed75cc34/a0df3679-6c69-53f3-837f-08eaed75cc34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bc23e376c15845af9794a11c670f7a66/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980329%27 HTTP/1.1" 200 None
2026-03-24 22:51:45 [ayvens.be] INFO: Saving data for 1980329: {'created_time': 1774392705.327415, 'last_price_update_time': 1774392705.327424, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980329') HTTP/1.1" 204 0
2026-03-24 22:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/2.jpg not downloaded yet
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/3.jpg not downloaded yet
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf4410>
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/6.jpg saved to cache
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bc450>
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/8.jpg saved to cache
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098705d0>
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/7.jpg saved to cache
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3b90>
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/9.jpg saved to cache
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/4.jpg not downloaded yet
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/5.jpg not downloaded yet
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009142190>
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eq%252F6ef5336e6d1548bbadf7b6a213bf6690%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/10.jpg saved to cache
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb7e5240-8a65-5e03-80d9-ed222dac75cd
2026-03-24 22:51:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb7e5240-8a65-5e03-80d9-ed222dac75cd, skipping ID generation
2026-03-24 22:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7e5240-8a65-5e03-80d9-ed222dac75cd with scrape type 1
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb7e5240-8a65-5e03-80d9-ed222dac75cd sending to next pipeline
2026-03-24 22:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eb7e5240-8a65-5e03-80d9-ed222dac75cd, identifier: 1980330
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/6.jpg not downloaded yet
2026-03-24 22:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1980330
2026-03-24 22:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1980330
2026-03-24 22:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1980330 to the API
2026-03-24 22:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eb7e5240-8a65-5e03-80d9-ed222dac75cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 54559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb7e5240-8a65-5e03-80d9-ed222dac75cd/eb7e5240-8a65-5e03-80d9-ed222dac75cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eq/6ef5336e6d1548bbadf7b6a213bf6690/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2024}
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980330%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [ayvens.be] INFO: Saving data for 1980330: {'created_time': 1774392706.197963, 'last_price_update_time': 1774392706.197972, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980330') HTTP/1.1" 204 0
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/7.jpg not downloaded yet
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/8.jpg not downloaded yet
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/9.jpg not downloaded yet
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/10.jpg not downloaded yet
2026-03-24 22:51:46 [ayvens.be] INFO: Found listing with ID: 1980333
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980333%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [ayvens.be] INFO: Scrape type for 1980333: 1
2026-03-24 22:51:46 [ayvens.be] INFO: Extracting data for car ID: 1980333
2026-03-24 22:51:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1980333
2026-03-24 22:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 with scrape type 1
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/1.jpg not downloaded yet
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/2.jpg not downloaded yet
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442310>
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/1.jpg saved to cache
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440a10>
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/2.jpg saved to cache
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464d50>
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/3.jpg saved to cache
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/3.jpg not downloaded yet
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/4.jpg not downloaded yet
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/5.jpg not downloaded yet
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838710>
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/7.jpg saved to cache
2026-03-24 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009870590>
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/4.jpg saved to cache
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347150>
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/6.jpg saved to cache
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946df50>
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/5.jpg saved to cache
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/6.jpg not downloaded yet
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/7.jpg not downloaded yet
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009863c10>
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/2.jpg saved to cache
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b450>
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/4.jpg saved to cache
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d6a50>
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/1.jpg saved to cache
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838b10>
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/3.jpg saved to cache
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/8.jpg not downloaded yet
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/9.jpg not downloaded yet
2026-03-24 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/10.jpg not downloaded yet
2026-03-24 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:47 [ayvens.be] INFO: Found listing with ID: 1980334
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980334%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [ayvens.be] INFO: Scrape type for 1980334: 1
2026-03-24 22:51:47 [ayvens.be] INFO: Extracting data for car ID: 1980334
2026-03-24 22:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1980334
2026-03-24 22:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0597b31-b618-5a7c-9897-7d9733dea90c with scrape type 1
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/1.jpg not downloaded yet
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/2.jpg not downloaded yet
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/3.jpg not downloaded yet
2026-03-24 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008346b10>
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/5.jpg saved to cache
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/4.jpg not downloaded yet
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/5.jpg not downloaded yet
2026-03-24 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/6.jpg not downloaded yet
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf6e10>
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/9.jpg saved to cache
2026-03-24 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946dad0>
2026-03-24 22:51:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/10.jpg saved to cache
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638c50>
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F2d3e470d17794eab8128bd94406f84b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/8.jpg saved to cache
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 054bf54d-3f34-5d87-91cc-317a6a689a28
2026-03-24 22:51:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 054bf54d-3f34-5d87-91cc-317a6a689a28, skipping ID generation
2026-03-24 22:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 054bf54d-3f34-5d87-91cc-317a6a689a28 with scrape type 1
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 054bf54d-3f34-5d87-91cc-317a6a689a28 sending to next pipeline
2026-03-24 22:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 054bf54d-3f34-5d87-91cc-317a6a689a28, identifier: 1980331
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009791e10>
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/6.jpg saved to cache
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a5ad0>
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/7.jpg saved to cache
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1980331
2026-03-24 22:51:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1980331
2026-03-24 22:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1980331 to the API
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'color': 'DARK PENTA METAL METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '054bf54d-3f34-5d87-91cc-317a6a689a28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 79955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 864900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_054bf54d-3f34-5d87-91cc-317a6a689a28/054bf54d-3f34-5d87-91cc-317a6a689a28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 903131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/2d3e470d17794eab8128bd94406f84b2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.6 GDI PHEV BUSINESS LINE DCT",
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV BUSINESS LINE DCT',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980331%27 HTTP/1.1" 200 None
2026-03-24 22:51:48 [ayvens.be] INFO: Saving data for 1980331: {'created_time': 1774392708.7997, 'last_price_update_time': 1774392708.799711, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980331') HTTP/1.1" 204 0
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/7.jpg not downloaded yet
2026-03-24 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/8.jpg not downloaded yet
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978a590>
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/3.jpg saved to cache
2026-03-24 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008381e10>
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/8.jpg saved to cache
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187bd0>
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/2.jpg saved to cache
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/9.jpg not downloaded yet
2026-03-24 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/10.jpg not downloaded yet
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd750>
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/1.jpg saved to cache
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664450>
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/10.jpg saved to cache
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:49 [ayvens.be] INFO: Found listing with ID: 1980335
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980335%27 HTTP/1.1" 200 None
2026-03-24 22:51:49 [ayvens.be] INFO: Scrape type for 1980335: 1
2026-03-24 22:51:49 [ayvens.be] INFO: Extracting data for car ID: 1980335
2026-03-24 22:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1980335
2026-03-24 22:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10aede45-dc31-5ff5-8678-55acc89a1832 with scrape type 1
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/1.jpg not downloaded yet
2026-03-24 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/2.jpg not downloaded yet
2026-03-24 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a2e90>
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Ff4b2de36c38142deb653ff547c501c4f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/9.jpg saved to cache
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81745107-cd5b-55d7-b04b-60f6322262e6
2026-03-24 22:51:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81745107-cd5b-55d7-b04b-60f6322262e6, skipping ID generation
2026-03-24 22:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81745107-cd5b-55d7-b04b-60f6322262e6 with scrape type 1
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81745107-cd5b-55d7-b04b-60f6322262e6 sending to next pipeline
2026-03-24 22:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 81745107-cd5b-55d7-b04b-60f6322262e6, identifier: 1980332
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b7ce850>
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/4.jpg saved to cache
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/3.jpg not downloaded yet
2026-03-24 22:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1980332
2026-03-24 22:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1980332
2026-03-24 22:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1980332 to the API
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '81745107-cd5b-55d7-b04b-60f6322262e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 55405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81745107-cd5b-55d7-b04b-60f6322262e6/81745107-cd5b-55d7-b04b-60f6322262e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/f4b2de36c38142deb653ff547c501c4f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980332%27 HTTP/1.1" 200 None
2026-03-24 22:51:49 [ayvens.be] INFO: Saving data for 1980332: {'created_time': 1774392709.95607, 'last_price_update_time': 1774392709.956086, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980332') HTTP/1.1" 204 0
2026-03-24 22:51:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/4.jpg not downloaded yet
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/5.jpg not downloaded yet
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e2650>
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/5.jpg saved to cache
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335e90>
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/6.jpg saved to cache
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096de9d0>
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/7.jpg saved to cache
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/6.jpg not downloaded yet
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/7.jpg not downloaded yet
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008313f50>
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/9.jpg saved to cache
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/8.jpg not downloaded yet
2026-03-24 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/9.jpg not downloaded yet
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/10.jpg not downloaded yet
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab910>
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/10.jpg saved to cache
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009941d90>
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fc67c4c713dee4776b36630ce4d383a98%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/8.jpg saved to cache
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e478d88-9255-5fdd-848c-32c5ddc31c17
2026-03-24 22:51:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e478d88-9255-5fdd-848c-32c5ddc31c17, skipping ID generation
2026-03-24 22:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 with scrape type 1
2026-03-24 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 sending to next pipeline
2026-03-24 22:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e478d88-9255-5fdd-848c-32c5ddc31c17, identifier: 1980333
2026-03-24 22:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1980333
2026-03-24 22:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1980333
2026-03-24 22:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1980333 to the API
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6e478d88-9255-5fdd-848c-32c5ddc31c17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 95069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e478d88-9255-5fdd-848c-32c5ddc31c17/6e478d88-9255-5fdd-848c-32c5ddc31c17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/c67c4c713dee4776b36630ce4d383a98/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980333%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [ayvens.be] INFO: Saving data for 1980333: {'created_time': 1774392711.059545, 'last_price_update_time': 1774392711.059555, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980333') HTTP/1.1" 204 0
2026-03-24 22:51:51 [ayvens.be] INFO: Found listing with ID: 1980336
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980336%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [ayvens.be] INFO: Scrape type for 1980336: 1
2026-03-24 22:51:51 [ayvens.be] INFO: Extracting data for car ID: 1980336
2026-03-24 22:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1980336
2026-03-24 22:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85823419-bea0-53d2-b46c-8cd10925d2b0 with scrape type 1
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/1.jpg not downloaded yet
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/2.jpg not downloaded yet
2026-03-24 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7f10>
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/2.jpg saved to cache
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098634d0>
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/6.jpg saved to cache
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009143850>
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/1.jpg saved to cache
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641a50>
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/3.jpg saved to cache
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962ea10>
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/5.jpg saved to cache
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/3.jpg not downloaded yet
2026-03-24 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/4.jpg not downloaded yet
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bf850>
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/1.jpg saved to cache
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/5.jpg not downloaded yet
2026-03-24 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/6.jpg not downloaded yet
2026-03-24 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/7.jpg not downloaded yet
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/8.jpg not downloaded yet
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009792b10>
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/4.jpg saved to cache
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/9.jpg not downloaded yet
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/10.jpg not downloaded yet
2026-03-24 22:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:51 [ayvens.be] INFO: Found listing with ID: 1980337
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980337%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [ayvens.be] INFO: Scrape type for 1980337: 1
2026-03-24 22:51:51 [ayvens.be] INFO: Extracting data for car ID: 1980337
2026-03-24 22:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1980337
2026-03-24 22:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3f7c41-dc83-5791-8842-4fd94dd6637f with scrape type 1
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/1.jpg not downloaded yet
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095a8e90>
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/10.jpg saved to cache
2026-03-24 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6c90>
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/7.jpg saved to cache
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839b590>
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/2.jpg saved to cache
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2cd0>
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/9.jpg saved to cache
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836ae10>
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F72707f1382e24a609a2cbf9f09df5298%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/8.jpg saved to cache
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0597b31-b618-5a7c-9897-7d9733dea90c
2026-03-24 22:51:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0597b31-b618-5a7c-9897-7d9733dea90c, skipping ID generation
2026-03-24 22:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0597b31-b618-5a7c-9897-7d9733dea90c with scrape type 1
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0597b31-b618-5a7c-9897-7d9733dea90c sending to next pipeline
2026-03-24 22:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0597b31-b618-5a7c-9897-7d9733dea90c, identifier: 1980334
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f37d0>
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/3.jpg saved to cache
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1980334
2026-03-24 22:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1980334
2026-03-24 22:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1980334 to the API
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b0597b31-b618-5a7c-9897-7d9733dea90c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 102948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0597b31-b618-5a7c-9897-7d9733dea90c/b0597b31-b618-5a7c-9897-7d9733dea90c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/72707f1382e24a609a2cbf9f09df5298/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980334%27 HTTP/1.1" 200 None
2026-03-24 22:51:52 [ayvens.be] INFO: Saving data for 1980334: {'created_time': 1774392712.721243, 'last_price_update_time': 1774392712.721253, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980334') HTTP/1.1" 204 0
2026-03-24 22:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/2.jpg not downloaded yet
2026-03-24 22:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/3.jpg not downloaded yet
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0175a1810>
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/6.jpg saved to cache
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971ab50>
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/8.jpg saved to cache
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/4.jpg not downloaded yet
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/5.jpg not downloaded yet
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009466390>
2026-03-24 22:51:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/4.jpg saved to cache
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913f510>
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/7.jpg saved to cache
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008326e10>
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/10.jpg saved to cache
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913f590>
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/9.jpg saved to cache
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/6.jpg not downloaded yet
2026-03-24 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/7.jpg not downloaded yet
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc5c90>
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F10a6d218be62416e91862688e060ae18%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/5.jpg saved to cache
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10aede45-dc31-5ff5-8678-55acc89a1832
2026-03-24 22:51:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10aede45-dc31-5ff5-8678-55acc89a1832, skipping ID generation
2026-03-24 22:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10aede45-dc31-5ff5-8678-55acc89a1832 with scrape type 1
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10aede45-dc31-5ff5-8678-55acc89a1832 sending to next pipeline
2026-03-24 22:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 10aede45-dc31-5ff5-8678-55acc89a1832, identifier: 1980335
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008368d10>
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/1.jpg saved to cache
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/8.jpg not downloaded yet
2026-03-24 22:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1980335
2026-03-24 22:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1980335
2026-03-24 22:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1980335 to the API
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '10aede45-dc31-5ff5-8678-55acc89a1832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 106199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10aede45-dc31-5ff5-8678-55acc89a1832/10aede45-dc31-5ff5-8678-55acc89a1832_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/10a6d218be62416e91862688e060ae18/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980335%27 HTTP/1.1" 200 None
2026-03-24 22:51:53 [ayvens.be] INFO: Saving data for 1980335: {'created_time': 1774392713.880824, 'last_price_update_time': 1774392713.880833, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980335') HTTP/1.1" 204 0
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/9.jpg not downloaded yet
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/10.jpg not downloaded yet
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0b50>
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/2.jpg saved to cache
2026-03-24 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f2050>
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/3.jpg saved to cache
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083baad0>
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/4.jpg saved to cache
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ba590>
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/5.jpg saved to cache
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009012710>
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/7.jpg saved to cache
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008386910>
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/6.jpg saved to cache
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b06c050>
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/8.jpg saved to cache
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:54 [ayvens.be] INFO: Found listing with ID: 1980338
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980338%27 HTTP/1.1" 200 None
2026-03-24 22:51:54 [ayvens.be] INFO: Scrape type for 1980338: 1
2026-03-24 22:51:54 [ayvens.be] INFO: Extracting data for car ID: 1980338
2026-03-24 22:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1980338
2026-03-24 22:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b32218-266b-566a-b43d-7beff4118cd2 with scrape type 1
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/1.jpg not downloaded yet
2026-03-24 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/2.jpg not downloaded yet
2026-03-24 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/3.jpg not downloaded yet
2026-03-24 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/4.jpg not downloaded yet
2026-03-24 22:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/5.jpg not downloaded yet
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/6.jpg not downloaded yet
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/7.jpg not downloaded yet
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c25d0>
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/10.jpg saved to cache
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ed6d0>
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F56384b432119449aac13e431dd976750%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/9.jpg saved to cache
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85823419-bea0-53d2-b46c-8cd10925d2b0
2026-03-24 22:51:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85823419-bea0-53d2-b46c-8cd10925d2b0, skipping ID generation
2026-03-24 22:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85823419-bea0-53d2-b46c-8cd10925d2b0 with scrape type 1
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85823419-bea0-53d2-b46c-8cd10925d2b0 sending to next pipeline
2026-03-24 22:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85823419-bea0-53d2-b46c-8cd10925d2b0, identifier: 1980336
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bca10>
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/1.jpg saved to cache
2026-03-24 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008387a50>
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/2.jpg saved to cache
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/8.jpg not downloaded yet
2026-03-24 22:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1980336
2026-03-24 22:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1980336
2026-03-24 22:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1980336 to the API
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '85823419-bea0-53d2-b46c-8cd10925d2b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 100619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85823419-bea0-53d2-b46c-8cd10925d2b0/85823419-bea0-53d2-b46c-8cd10925d2b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/56384b432119449aac13e431dd976750/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980336%27 HTTP/1.1" 200 None
2026-03-24 22:51:55 [ayvens.be] INFO: Saving data for 1980336: {'created_time': 1774392715.345835, 'last_price_update_time': 1774392715.345846, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980336') HTTP/1.1" 204 0
2026-03-24 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/9.jpg not downloaded yet
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394a90>
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/5.jpg saved to cache
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3750>
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ffe1a5b666a89494bb3b6eb62f42f155b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/5.jpg saved to cache
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c
2026-03-24 22:51:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c, skipping ID generation
2026-03-24 22:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with scrape type 1
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c sending to next pipeline
2026-03-24 22:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c, identifier: 1980317
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b9d0>
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/3.jpg saved to cache
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091876d0>
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/4.jpg saved to cache
2026-03-24 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1980317
2026-03-24 22:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1980317
2026-03-24 22:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1980317 to the API
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '55de8cbe-2247-5b6f-b8d2-39ad91e6d17c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 40253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55de8cbe-2247-5b6f-b8d2-39ad91e6d17c/55de8cbe-2247-5b6f-b8d2-39ad91e6d17c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/fe1a5b666a89494bb3b6eb62f42f155b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.0 TCE 90 EQUILIBRE',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EQUILIBRE',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980317%27 HTTP/1.1" 200 None
2026-03-24 22:51:56 [ayvens.be] INFO: Saving data for 1980317: {'created_time': 1774392716.028491, 'last_price_update_time': 1774392716.0285, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980317') HTTP/1.1" 204 0
2026-03-24 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/10.jpg not downloaded yet
2026-03-24 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:56 [ayvens.be] INFO: Found listing with ID: 1980339
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980339%27 HTTP/1.1" 200 None
2026-03-24 22:51:56 [ayvens.be] INFO: Scrape type for 1980339: 1
2026-03-24 22:51:56 [ayvens.be] INFO: Extracting data for car ID: 1980339
2026-03-24 22:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65337357-52f9-53c5-aad2-e9c036ec7437 with identifier: 1980339
2026-03-24 22:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65337357-52f9-53c5-aad2-e9c036ec7437 with scrape type 1
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/1.jpg not downloaded yet
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009397f10>
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/8.jpg saved to cache
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3bd0>
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/6.jpg saved to cache
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009629dd0>
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/9.jpg saved to cache
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834ecd0>
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/7.jpg saved to cache
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009177690>
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/1.jpg saved to cache
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/2.jpg not downloaded yet
2026-03-24 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/3.jpg not downloaded yet
2026-03-24 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c6990>
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fd4ce94ef20aa4e77ada6a010a6b047c9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/10.jpg saved to cache
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac3f7c41-dc83-5791-8842-4fd94dd6637f
2026-03-24 22:51:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac3f7c41-dc83-5791-8842-4fd94dd6637f, skipping ID generation
2026-03-24 22:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3f7c41-dc83-5791-8842-4fd94dd6637f with scrape type 1
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac3f7c41-dc83-5791-8842-4fd94dd6637f sending to next pipeline
2026-03-24 22:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac3f7c41-dc83-5791-8842-4fd94dd6637f, identifier: 1980337
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914f790>
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/3.jpg saved to cache
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834ce10>
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/2.jpg saved to cache
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/4.jpg not downloaded yet
2026-03-24 22:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1980337
2026-03-24 22:51:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1980337
2026-03-24 22:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1980337 to the API
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'COSMOSZWART',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ac3f7c41-dc83-5791-8842-4fd94dd6637f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 120855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3f7c41-dc83-5791-8842-4fd94dd6637f/ac3f7c41-dc83-5791-8842-4fd94dd6637f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/d4ce94ef20aa4e77ada6a010a6b047c9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 2.0 A 180 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 A 180 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980337%27 HTTP/1.1" 200 None
2026-03-24 22:51:57 [ayvens.be] INFO: Saving data for 1980337: {'created_time': 1774392717.284993, 'last_price_update_time': 1774392717.285005, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980337') HTTP/1.1" 204 0
2026-03-24 22:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/5.jpg not downloaded yet
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc6e90>
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/5.jpg saved to cache
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009642bd0>
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/6.jpg saved to cache
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610810>
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/4.jpg saved to cache
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643d50>
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/7.jpg saved to cache
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00919a6d0>
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/9.jpg saved to cache
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/6.jpg not downloaded yet
2026-03-24 22:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a0150>
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/8.jpg saved to cache
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/7.jpg not downloaded yet
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/8.jpg not downloaded yet
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/9.jpg not downloaded yet
2026-03-24 22:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/10.jpg not downloaded yet
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bd350>
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fb0a025e3168144e1be0e0e17854d4a22%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/10.jpg saved to cache
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1b32218-266b-566a-b43d-7beff4118cd2
2026-03-24 22:51:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1b32218-266b-566a-b43d-7beff4118cd2, skipping ID generation
2026-03-24 22:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b32218-266b-566a-b43d-7beff4118cd2 with scrape type 1
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1b32218-266b-566a-b43d-7beff4118cd2 sending to next pipeline
2026-03-24 22:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1b32218-266b-566a-b43d-7beff4118cd2, identifier: 1980338
2026-03-24 22:51:58 [ayvens.be] INFO: Found listing with ID: 1980340
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980340%27 HTTP/1.1" 200 None
2026-03-24 22:51:58 [ayvens.be] INFO: Scrape type for 1980340: 1
2026-03-24 22:51:58 [ayvens.be] INFO: Extracting data for car ID: 1980340
2026-03-24 22:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1980340
2026-03-24 22:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 with scrape type 1
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/1.jpg not downloaded yet
2026-03-24 22:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1980338
2026-03-24 22:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1980338
2026-03-24 22:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1980338 to the API
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd1b32218-266b-566a-b43d-7beff4118cd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 139745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b32218-266b-566a-b43d-7beff4118cd2/d1b32218-266b-566a-b43d-7beff4118cd2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/b0a025e3168144e1be0e0e17854d4a22/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980338%27 HTTP/1.1" 200 None
2026-03-24 22:51:58 [ayvens.be] INFO: Saving data for 1980338: {'created_time': 1774392718.551797, 'last_price_update_time': 1774392718.551807, 'auction_closing_time': 1774530000.0}
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980338') HTTP/1.1" 204 0
2026-03-24 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/2.jpg not downloaded yet
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372910>
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/1.jpg saved to cache
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/3.jpg not downloaded yet
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/4.jpg not downloaded yet
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a294d0>
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/2.jpg saved to cache
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3790>
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/3.jpg saved to cache
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/5.jpg not downloaded yet
2026-03-24 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/6.jpg not downloaded yet
2026-03-24 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009177610>
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/4.jpg saved to cache
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/7.jpg not downloaded yet
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/8.jpg not downloaded yet
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369e10>
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/7.jpg saved to cache
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b7ed0>
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/5.jpg saved to cache
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009943610>
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/6.jpg saved to cache
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/9.jpg not downloaded yet
2026-03-24 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1e10>
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/8.jpg saved to cache
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d6790>
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/9.jpg saved to cache
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/10.jpg not downloaded yet
2026-03-24 22:51:59 [ayvens.be] INFO: Found listing with ID: 1980341
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980341%27 HTTP/1.1" 200 None
2026-03-24 22:51:59 [ayvens.be] INFO: Scrape type for 1980341: 1
2026-03-24 22:51:59 [ayvens.be] INFO: Extracting data for car ID: 1980341
2026-03-24 22:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1980341
2026-03-24 22:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with scrape type 1
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/1.jpg not downloaded yet
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009491110>
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:51:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cd%252F77426dd8f49c4f37b25314c089ce0f29%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/10.jpg saved to cache
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65337357-52f9-53c5-aad2-e9c036ec7437
2026-03-24 22:51:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65337357-52f9-53c5-aad2-e9c036ec7437, skipping ID generation
2026-03-24 22:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65337357-52f9-53c5-aad2-e9c036ec7437 with scrape type 1
2026-03-24 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65337357-52f9-53c5-aad2-e9c036ec7437 sending to next pipeline
2026-03-24 22:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 65337357-52f9-53c5-aad2-e9c036ec7437, identifier: 1980339
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bd190>
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/1.jpg saved to cache
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3050>
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/2.jpg saved to cache
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 65337357-52f9-53c5-aad2-e9c036ec7437 with identifier: 1980339
2026-03-24 22:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 65337357-52f9-53c5-aad2-e9c036ec7437 with identifier: 1980339
2026-03-24 22:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 65337357-52f9-53c5-aad2-e9c036ec7437 with identifier: 1980339 to the API
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '65337357-52f9-53c5-aad2-e9c036ec7437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3-serie',
 'odometer': 56141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65337357-52f9-53c5-aad2-e9c036ec7437/65337357-52f9-53c5-aad2-e9c036ec7437_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cd/77426dd8f49c4f37b25314c089ce0f29/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3-serie 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980339%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [ayvens.be] INFO: Saving data for 1980339: {'created_time': 1774392720.567764, 'last_price_update_time': 1774392720.567773, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980339') HTTP/1.1" 204 0
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/2.jpg not downloaded yet
2026-03-24 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/3.jpg not downloaded yet
2026-03-24 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/4.jpg not downloaded yet
2026-03-24 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/5.jpg not downloaded yet
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/6.jpg not downloaded yet
2026-03-24 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/7.jpg not downloaded yet
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/8.jpg not downloaded yet
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6110>
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/3.jpg saved to cache
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/9.jpg not downloaded yet
2026-03-24 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/10.jpg not downloaded yet
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983bf10>
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/4.jpg saved to cache
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835ad10>
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/5.jpg saved to cache
2026-03-24 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083869d0>
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/6.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788990>
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/7.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02f90>
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/9.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359850>
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/8.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:01 [ayvens.be] INFO: Found listing with ID: 1980342
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980342%27 HTTP/1.1" 200 None
2026-03-24 22:52:01 [ayvens.be] INFO: Scrape type for 1980342: 1
2026-03-24 22:52:01 [ayvens.be] INFO: Extracting data for car ID: 1980342
2026-03-24 22:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1980342
2026-03-24 22:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f721e15-332b-51f4-b704-261dcb3d5496 with scrape type 1
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/1.jpg not downloaded yet
2026-03-24 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d01050>
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/2.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009395d10>
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/1.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/2.jpg not downloaded yet
2026-03-24 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/3.jpg not downloaded yet
2026-03-24 22:52:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098608d0>
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/3.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472fd0>
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/4.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964d850>
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fa5012ad8714e4ace91f59de85f1d2587%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/10.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f848b84-78f6-5388-b7ab-a5470e154ec1
2026-03-24 22:52:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f848b84-78f6-5388-b7ab-a5470e154ec1, skipping ID generation
2026-03-24 22:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 with scrape type 1
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 sending to next pipeline
2026-03-24 22:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f848b84-78f6-5388-b7ab-a5470e154ec1, identifier: 1980340
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008385690>
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/6.jpg saved to cache
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/4.jpg not downloaded yet
2026-03-24 22:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1980340
2026-03-24 22:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1980340
2026-03-24 22:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1980340 to the API
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '9f848b84-78f6-5388-b7ab-a5470e154ec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 53679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f848b84-78f6-5388-b7ab-a5470e154ec1/9f848b84-78f6-5388-b7ab-a5470e154ec1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/a5012ad8714e4ace91f59de85f1d2587/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 225E PHEV DCT XDRIVE ACTIVE TOURER',
 'transmission': 'automatic',
 'trim': '1.5 225E PHEV DCT XDRIVE ACTIVE TOURER',
 'vin': None,
 'year': 2023}
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980340%27 HTTP/1.1" 200 None
2026-03-24 22:52:02 [ayvens.be] INFO: Saving data for 1980340: {'created_time': 1774392722.285078, 'last_price_update_time': 1774392722.285089, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980340') HTTP/1.1" 204 0
2026-03-24 22:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/5.jpg not downloaded yet
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fb490>
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/5.jpg saved to cache
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009198950>
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/7.jpg saved to cache
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9ad0>
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/9.jpg saved to cache
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/6.jpg not downloaded yet
2026-03-24 22:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911d490>
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/8.jpg saved to cache
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/7.jpg not downloaded yet
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/8.jpg not downloaded yet
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309ad0>
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F63e66a6b7b5244f38c6d70ac807b118e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/10.jpg saved to cache
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d
2026-03-24 22:52:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d, skipping ID generation
2026-03-24 22:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with scrape type 1
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d sending to next pipeline
2026-03-24 22:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d, identifier: 1980341
2026-03-24 22:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/9.jpg not downloaded yet
2026-03-24 22:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1980341
2026-03-24 22:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1980341
2026-03-24 22:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1980341 to the API
2026-03-24 22:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 120814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d/24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/63e66a6b7b5244f38c6d70ac807b118e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 518D 110KW TOURING AUTO',
 'transmission': 'automatic',
 'trim': '2.0 518D 110KW TOURING AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980341%27 HTTP/1.1" 200 None
2026-03-24 22:52:03 [ayvens.be] INFO: Saving data for 1980341: {'created_time': 1774392723.155526, 'last_price_update_time': 1774392723.155537, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980341') HTTP/1.1" 204 0
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/10.jpg not downloaded yet
2026-03-24 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b60c90>
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/1.jpg saved to cache
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:03 [ayvens.be] INFO: Found listing with ID: 1980343
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980343%27 HTTP/1.1" 200 None
2026-03-24 22:52:03 [ayvens.be] INFO: Scrape type for 1980343: 1
2026-03-24 22:52:03 [ayvens.be] INFO: Extracting data for car ID: 1980343
2026-03-24 22:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1980343
2026-03-24 22:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553a68b8-cbe1-5949-add3-97bebbbbfdee with scrape type 1
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/1.jpg not downloaded yet
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/2.jpg not downloaded yet
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d01d90>
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/2.jpg saved to cache
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/3.jpg not downloaded yet
2026-03-24 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/4.jpg not downloaded yet
2026-03-24 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008383d50>
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/3.jpg saved to cache
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/5.jpg not downloaded yet
2026-03-24 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/6.jpg not downloaded yet
2026-03-24 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c65d0>
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/6.jpg saved to cache
2026-03-24 22:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a1fd0>
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/5.jpg saved to cache
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009565f50>
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/4.jpg saved to cache
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/7.jpg not downloaded yet
2026-03-24 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/8.jpg not downloaded yet
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008371a10>
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/7.jpg saved to cache
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a05d0>
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/8.jpg saved to cache
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382e10>
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/10.jpg saved to cache
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/9.jpg not downloaded yet
2026-03-24 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/10.jpg not downloaded yet
2026-03-24 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945a050>
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F2a84d9c9df0c4b388acf313041296cde%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/9.jpg saved to cache
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f721e15-332b-51f4-b704-261dcb3d5496
2026-03-24 22:52:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f721e15-332b-51f4-b704-261dcb3d5496, skipping ID generation
2026-03-24 22:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f721e15-332b-51f4-b704-261dcb3d5496 with scrape type 1
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f721e15-332b-51f4-b704-261dcb3d5496 sending to next pipeline
2026-03-24 22:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3f721e15-332b-51f4-b704-261dcb3d5496, identifier: 1980342
2026-03-24 22:52:04 [ayvens.be] INFO: Found listing with ID: 1980344
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980344%27 HTTP/1.1" 200 None
2026-03-24 22:52:04 [ayvens.be] INFO: Scrape type for 1980344: 1
2026-03-24 22:52:04 [ayvens.be] INFO: Extracting data for car ID: 1980344
2026-03-24 22:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1980344
2026-03-24 22:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with scrape type 1
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/1.jpg not downloaded yet
2026-03-24 22:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1980342
2026-03-24 22:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1980342
2026-03-24 22:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1980342 to the API
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3f721e15-332b-51f4-b704-261dcb3d5496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 56982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f721e15-332b-51f4-b704-261dcb3d5496/3f721e15-332b-51f4-b704-261dcb3d5496_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/2a84d9c9df0c4b388acf313041296cde/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980342%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [ayvens.be] INFO: Saving data for 1980342: {'created_time': 1774392725.01426, 'last_price_update_time': 1774392725.01427, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980342') HTTP/1.1" 204 0
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/2.jpg not downloaded yet
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/3.jpg not downloaded yet
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347a50>
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/2.jpg saved to cache
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834f950>
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/1.jpg saved to cache
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/4.jpg not downloaded yet
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc6150>
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/3.jpg saved to cache
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00c8f1710>
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/4.jpg saved to cache
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/5.jpg not downloaded yet
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/6.jpg not downloaded yet
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406890>
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/5.jpg saved to cache
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/7.jpg not downloaded yet
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110f10>
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/6.jpg saved to cache
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912bc50>
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/7.jpg saved to cache
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/8.jpg not downloaded yet
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/9.jpg not downloaded yet
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/10.jpg not downloaded yet
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [ayvens.be] INFO: Found listing with ID: 1980345
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980345%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [ayvens.be] INFO: Scrape type for 1980345: 1
2026-03-24 22:52:05 [ayvens.be] INFO: Extracting data for car ID: 1980345
2026-03-24 22:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1980345
2026-03-24 22:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e367b0-917d-51cc-9c21-36a4976b89c1 with scrape type 1
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/1.jpg not downloaded yet
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/2.jpg not downloaded yet
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/3.jpg not downloaded yet
2026-03-24 22:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d8b90>
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/8.jpg saved to cache
2026-03-24 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912a110>
2026-03-24 22:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/9.jpg saved to cache
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/4.jpg not downloaded yet
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/5.jpg not downloaded yet
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c0090>
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fe2d9b751e3d041b8b06fe6583e5df393%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/10.jpg saved to cache
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 553a68b8-cbe1-5949-add3-97bebbbbfdee
2026-03-24 22:52:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 553a68b8-cbe1-5949-add3-97bebbbbfdee, skipping ID generation
2026-03-24 22:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553a68b8-cbe1-5949-add3-97bebbbbfdee with scrape type 1
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 553a68b8-cbe1-5949-add3-97bebbbbfdee sending to next pipeline
2026-03-24 22:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 553a68b8-cbe1-5949-add3-97bebbbbfdee, identifier: 1980343
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d6790>
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/1.jpg saved to cache
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc4c90>
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/2.jpg saved to cache
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912b590>
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/3.jpg saved to cache
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121710>
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/5.jpg saved to cache
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/6.jpg not downloaded yet
2026-03-24 22:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1980343
2026-03-24 22:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1980343
2026-03-24 22:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1980343 to the API
2026-03-24 22:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '553a68b8-cbe1-5949-add3-97bebbbbfdee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 59283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 874816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553a68b8-cbe1-5949-add3-97bebbbbfdee/553a68b8-cbe1-5949-add3-97bebbbbfdee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/e2d9b751e3d041b8b06fe6583e5df393/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980343%27 HTTP/1.1" 200 None
2026-03-24 22:52:07 [ayvens.be] INFO: Saving data for 1980343: {'created_time': 1774392727.222281, 'last_price_update_time': 1774392727.22229, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980343') HTTP/1.1" 204 0
2026-03-24 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 1 pages/min), scraped 333 items (at 38 items/min)
2026-03-24 22:52:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/7.jpg not downloaded yet
2026-03-24 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/8.jpg not downloaded yet
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3b50>
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/4.jpg saved to cache
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/9.jpg not downloaded yet
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/10.jpg not downloaded yet
2026-03-24 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910d490>
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/7.jpg saved to cache
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094401d0>
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/1.jpg saved to cache
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:07 [ayvens.be] INFO: Found listing with ID: 1980346
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980346%27 HTTP/1.1" 200 None
2026-03-24 22:52:07 [ayvens.be] INFO: Scrape type for 1980346: 1
2026-03-24 22:52:07 [ayvens.be] INFO: Extracting data for car ID: 1980346
2026-03-24 22:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1980346
2026-03-24 22:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7daffc16-00ab-5d2a-b461-726a3cb29f81 with scrape type 1
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/1.jpg not downloaded yet
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/2.jpg not downloaded yet
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e990>
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/4.jpg saved to cache
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be590>
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/6.jpg saved to cache
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009176550>
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/10.jpg saved to cache
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3350>
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/2.jpg saved to cache
2026-03-24 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449510>
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/3.jpg saved to cache
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/3.jpg not downloaded yet
2026-03-24 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008337bd0>
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/8.jpg saved to cache
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009791210>
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fa7aee92078ff456cae447546365cc61b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/9.jpg saved to cache
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0
2026-03-24 22:52:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0, skipping ID generation
2026-03-24 22:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with scrape type 1
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 sending to next pipeline
2026-03-24 22:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0, identifier: 1980344
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/4.jpg not downloaded yet
2026-03-24 22:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1980344
2026-03-24 22:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1980344
2026-03-24 22:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1980344 to the API
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f23d59d4-bf04-53b9-9d1d-7ba64f201fe0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 86813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 890446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 909646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23d59d4-bf04-53b9-9d1d-7ba64f201fe0/f23d59d4-bf04-53b9-9d1d-7ba64f201fe0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/a7aee92078ff456cae447546365cc61b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 1.4 TSI PHEV 150KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 150KW DSG CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980344%27 HTTP/1.1" 200 None
2026-03-24 22:52:08 [ayvens.be] INFO: Saving data for 1980344: {'created_time': 1774392728.637483, 'last_price_update_time': 1774392728.637496, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980344') HTTP/1.1" 204 0
2026-03-24 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/5.jpg not downloaded yet
2026-03-24 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d7c50>
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/6.jpg saved to cache
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838850>
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/5.jpg saved to cache
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/6.jpg not downloaded yet
2026-03-24 22:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/7.jpg not downloaded yet
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3ed0>
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/8.jpg saved to cache
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099401d0>
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/7.jpg saved to cache
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a1510>
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/9.jpg saved to cache
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/8.jpg not downloaded yet
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/9.jpg not downloaded yet
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096642d0>
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fe9224f1af52449b987a100b9f5120fca%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/10.jpg saved to cache
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63e367b0-917d-51cc-9c21-36a4976b89c1
2026-03-24 22:52:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63e367b0-917d-51cc-9c21-36a4976b89c1, skipping ID generation
2026-03-24 22:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e367b0-917d-51cc-9c21-36a4976b89c1 with scrape type 1
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63e367b0-917d-51cc-9c21-36a4976b89c1 sending to next pipeline
2026-03-24 22:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63e367b0-917d-51cc-9c21-36a4976b89c1, identifier: 1980345
2026-03-24 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1980345
2026-03-24 22:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1980345
2026-03-24 22:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1980345 to the API
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '63e367b0-917d-51cc-9c21-36a4976b89c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 91752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e367b0-917d-51cc-9c21-36a4976b89c1/63e367b0-917d-51cc-9c21-36a4976b89c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/e9224f1af52449b987a100b9f5120fca/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 1.0 TSI STYLE',
 'transmission': 'manual',
 'trim': '1.0 TSI STYLE',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980345%27 HTTP/1.1" 200 None
2026-03-24 22:52:09 [ayvens.be] INFO: Saving data for 1980345: {'created_time': 1774392729.681657, 'last_price_update_time': 1774392729.681666, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980345') HTTP/1.1" 204 0
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/10.jpg not downloaded yet
2026-03-24 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:09 [ayvens.be] INFO: Found listing with ID: 1980347
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980347%27 HTTP/1.1" 200 None
2026-03-24 22:52:09 [ayvens.be] INFO: Scrape type for 1980347: 1
2026-03-24 22:52:09 [ayvens.be] INFO: Extracting data for car ID: 1980347
2026-03-24 22:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1980347
2026-03-24 22:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89b0c35-1801-582d-a8b4-24273842471b with scrape type 1
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/1.jpg not downloaded yet
2026-03-24 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834e7d0>
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/1.jpg saved to cache
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/2.jpg not downloaded yet
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/3.jpg not downloaded yet
2026-03-24 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/4.jpg not downloaded yet
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f5d0>
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/3.jpg saved to cache
2026-03-24 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3f90>
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/2.jpg saved to cache
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/5.jpg not downloaded yet
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464150>
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/4.jpg saved to cache
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b8fd0>
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/5.jpg saved to cache
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/6.jpg not downloaded yet
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/7.jpg not downloaded yet
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b350>
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/7.jpg saved to cache
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1850>
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/6.jpg saved to cache
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/8.jpg not downloaded yet
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/9.jpg not downloaded yet
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/10.jpg not downloaded yet
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [ayvens.be] INFO: Found listing with ID: 1980348
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980348%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [ayvens.be] INFO: Scrape type for 1980348: 1
2026-03-24 22:52:10 [ayvens.be] INFO: Extracting data for car ID: 1980348
2026-03-24 22:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0d631ba-76f2-5865-bce7-5ea052ac5323 with identifier: 1980348
2026-03-24 22:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d631ba-76f2-5865-bce7-5ea052ac5323 with scrape type 1
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/1.jpg not downloaded yet
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/2.jpg not downloaded yet
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/3.jpg not downloaded yet
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f0ad0>
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/8.jpg saved to cache
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/4.jpg not downloaded yet
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/5.jpg not downloaded yet
2026-03-24 22:52:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/6.jpg not downloaded yet
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9050>
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/9.jpg saved to cache
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009771090>
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F84e88edbb10d47f58b4968579a56addd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/10.jpg saved to cache
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7daffc16-00ab-5d2a-b461-726a3cb29f81
2026-03-24 22:52:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7daffc16-00ab-5d2a-b461-726a3cb29f81, skipping ID generation
2026-03-24 22:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7daffc16-00ab-5d2a-b461-726a3cb29f81 with scrape type 1
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7daffc16-00ab-5d2a-b461-726a3cb29f81 sending to next pipeline
2026-03-24 22:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7daffc16-00ab-5d2a-b461-726a3cb29f81, identifier: 1980346
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962ed50>
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/1.jpg saved to cache
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0a90>
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/3.jpg saved to cache
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098396d0>
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/2.jpg saved to cache
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009770490>
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/5.jpg saved to cache
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00ca56490>
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/4.jpg saved to cache
2026-03-24 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1980346
2026-03-24 22:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1980346
2026-03-24 22:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1980346 to the API
2026-03-24 22:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '7daffc16-00ab-5d2a-b461-726a3cb29f81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 29648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7daffc16-00ab-5d2a-b461-726a3cb29f81/7daffc16-00ab-5d2a-b461-726a3cb29f81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/84e88edbb10d47f58b4968579a56addd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW',
 'vin': None,
 'year': 2023}
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980346%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [ayvens.be] INFO: Saving data for 1980346: {'created_time': 1774392732.171455, 'last_price_update_time': 1774392732.171464, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980346') HTTP/1.1" 204 0
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/7.jpg not downloaded yet
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/8.jpg not downloaded yet
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c52d0>
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/1.jpg saved to cache
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/9.jpg not downloaded yet
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/10.jpg not downloaded yet
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [ayvens.be] INFO: Found listing with ID: 1980349
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980349%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [ayvens.be] INFO: Scrape type for 1980349: 1
2026-03-24 22:52:12 [ayvens.be] INFO: Extracting data for car ID: 1980349
2026-03-24 22:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1980349
2026-03-24 22:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d369e5-2928-5f10-b01e-b85ea21d67cf with scrape type 1
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/1.jpg not downloaded yet
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/2.jpg not downloaded yet
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/3.jpg not downloaded yet
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c5210>
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/6.jpg saved to cache
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/4.jpg not downloaded yet
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097607d0>
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/7.jpg saved to cache
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/5.jpg not downloaded yet
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/6.jpg not downloaded yet
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b6c90>
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/9.jpg saved to cache
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009142350>
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/8.jpg saved to cache
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e1e10>
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Faadb15b370844014be084b97a94c3a7b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/10.jpg saved to cache
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e89b0c35-1801-582d-a8b4-24273842471b
2026-03-24 22:52:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e89b0c35-1801-582d-a8b4-24273842471b, skipping ID generation
2026-03-24 22:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89b0c35-1801-582d-a8b4-24273842471b with scrape type 1
2026-03-24 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e89b0c35-1801-582d-a8b4-24273842471b sending to next pipeline
2026-03-24 22:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e89b0c35-1801-582d-a8b4-24273842471b, identifier: 1980347
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d972d0>
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/4.jpg saved to cache
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d4c90>
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/6.jpg saved to cache
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009773050>
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/5.jpg saved to cache
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761310>
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/2.jpg saved to cache
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1980347
2026-03-24 22:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1980347
2026-03-24 22:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1980347 to the API
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e89b0c35-1801-582d-a8b4-24273842471b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 95959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89b0c35-1801-582d-a8b4-24273842471b/e89b0c35-1801-582d-a8b4-24273842471b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 822205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/aadb15b370844014be084b97a94c3a7b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980347%27 HTTP/1.1" 200 None
2026-03-24 22:52:13 [ayvens.be] INFO: Saving data for 1980347: {'created_time': 1774392733.63158, 'last_price_update_time': 1774392733.631592, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980347') HTTP/1.1" 204 0
2026-03-24 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/7.jpg not downloaded yet
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834e150>
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/7.jpg saved to cache
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788c50>
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/9.jpg saved to cache
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/8.jpg not downloaded yet
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873d10>
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/8.jpg saved to cache
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/9.jpg not downloaded yet
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cc390>
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/10.jpg saved to cache
2026-03-24 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b5210>
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dv%252F0e1a8e6053d5413d8c28e618be688724%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/3.jpg saved to cache
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0d631ba-76f2-5865-bce7-5ea052ac5323
2026-03-24 22:52:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0d631ba-76f2-5865-bce7-5ea052ac5323, skipping ID generation
2026-03-24 22:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d631ba-76f2-5865-bce7-5ea052ac5323 with scrape type 1
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0d631ba-76f2-5865-bce7-5ea052ac5323 sending to next pipeline
2026-03-24 22:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0d631ba-76f2-5865-bce7-5ea052ac5323, identifier: 1980348
2026-03-24 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0d631ba-76f2-5865-bce7-5ea052ac5323 with identifier: 1980348
2026-03-24 22:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0d631ba-76f2-5865-bce7-5ea052ac5323 with identifier: 1980348
2026-03-24 22:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0d631ba-76f2-5865-bce7-5ea052ac5323 with identifier: 1980348 to the API
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd0d631ba-76f2-5865-bce7-5ea052ac5323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'ALFA ROMEO',
 'model': 'TONALE',
 'odometer': 58482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d631ba-76f2-5865-bce7-5ea052ac5323/d0d631ba-76f2-5865-bce7-5ea052ac5323_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dv/0e1a8e6053d5413d8c28e618be688724/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'ALFA ROMEO TONALE 1.3 PHEV 206KW 4WD AUTO VELOCE',
 'transmission': 'automatic',
 'trim': '1.3 PHEV 206KW 4WD AUTO VELOCE',
 'vin': None,
 'year': 2023}
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980348%27 HTTP/1.1" 200 None
2026-03-24 22:52:14 [ayvens.be] INFO: Saving data for 1980348: {'created_time': 1774392734.407827, 'last_price_update_time': 1774392734.407837, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980348') HTTP/1.1" 204 0
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/10.jpg not downloaded yet
2026-03-24 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009860d50>
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/1.jpg saved to cache
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938f410>
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/2.jpg saved to cache
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009008750>
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/3.jpg saved to cache
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:14 [ayvens.be] INFO: Found listing with ID: 1980350
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980350%27 HTTP/1.1" 200 None
2026-03-24 22:52:14 [ayvens.be] INFO: Scrape type for 1980350: 1
2026-03-24 22:52:14 [ayvens.be] INFO: Extracting data for car ID: 1980350
2026-03-24 22:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with identifier: 1980350
2026-03-24 22:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with scrape type 1
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/1.jpg not downloaded yet
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911f810>
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/4.jpg saved to cache
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/2.jpg not downloaded yet
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978b750>
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/5.jpg saved to cache
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/3.jpg not downloaded yet
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bf150>
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/6.jpg saved to cache
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/4.jpg not downloaded yet
2026-03-24 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/5.jpg not downloaded yet
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/6.jpg not downloaded yet
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343690>
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/7.jpg saved to cache
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/7.jpg not downloaded yet
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/8.jpg not downloaded yet
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978b910>
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/8.jpg saved to cache
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009191290>
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/9.jpg saved to cache
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945e950>
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vb%252F64cdbdce02da40c1b847322db5ed325d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/10.jpg saved to cache
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54d369e5-2928-5f10-b01e-b85ea21d67cf
2026-03-24 22:52:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54d369e5-2928-5f10-b01e-b85ea21d67cf, skipping ID generation
2026-03-24 22:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d369e5-2928-5f10-b01e-b85ea21d67cf with scrape type 1
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54d369e5-2928-5f10-b01e-b85ea21d67cf sending to next pipeline
2026-03-24 22:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 54d369e5-2928-5f10-b01e-b85ea21d67cf, identifier: 1980349
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/9.jpg not downloaded yet
2026-03-24 22:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1980349
2026-03-24 22:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1980349
2026-03-24 22:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1980349 to the API
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '54d369e5-2928-5f10-b01e-b85ea21d67cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 112829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54d369e5-2928-5f10-b01e-b85ea21d67cf/54d369e5-2928-5f10-b01e-b85ea21d67cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vb/64cdbdce02da40c1b847322db5ed325d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980349%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [ayvens.be] INFO: Saving data for 1980349: {'created_time': 1774392735.871391, 'last_price_update_time': 1774392735.871399, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980349') HTTP/1.1" 204 0
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/10.jpg not downloaded yet
2026-03-24 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:15 [ayvens.be] INFO: Found listing with ID: 1980351
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980351%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [ayvens.be] INFO: Scrape type for 1980351: 1
2026-03-24 22:52:15 [ayvens.be] INFO: Extracting data for car ID: 1980351
2026-03-24 22:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with identifier: 1980351
2026-03-24 22:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with scrape type 1
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/1.jpg not downloaded yet
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/2.jpg not downloaded yet
2026-03-24 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/3.jpg not downloaded yet
2026-03-24 22:52:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/4.jpg not downloaded yet
2026-03-24 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/5.jpg not downloaded yet
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/6.jpg not downloaded yet
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912aed0>
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/1.jpg saved to cache
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/7.jpg not downloaded yet
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/8.jpg not downloaded yet
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912b610>
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/3.jpg saved to cache
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3d10>
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/2.jpg saved to cache
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb3d10>
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/4.jpg saved to cache
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144d50>
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/7.jpg saved to cache
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914d310>
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/5.jpg saved to cache
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916c8d0>
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/6.jpg saved to cache
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/9.jpg not downloaded yet
2026-03-24 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/10.jpg not downloaded yet
2026-03-24 22:52:16 [ayvens.be] INFO: Found listing with ID: 1980352
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980352%27 HTTP/1.1" 200 None
2026-03-24 22:52:16 [ayvens.be] INFO: Scrape type for 1980352: 1
2026-03-24 22:52:16 [ayvens.be] INFO: Extracting data for car ID: 1980352
2026-03-24 22:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1980352
2026-03-24 22:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af974b1e-bc76-523e-80e0-698c29fe183c with scrape type 1
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/1.jpg not downloaded yet
2026-03-24 22:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/2.jpg not downloaded yet
2026-03-24 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/3.jpg not downloaded yet
2026-03-24 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/4.jpg not downloaded yet
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008386f50>
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/10.jpg saved to cache
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008325d10>
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/8.jpg saved to cache
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/5.jpg not downloaded yet
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/6.jpg not downloaded yet
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/7.jpg not downloaded yet
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c11d0>
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F65f902e882c6400e8db81d121827fd29%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/9.jpg saved to cache
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785
2026-03-24 22:52:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785, skipping ID generation
2026-03-24 22:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with scrape type 1
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 sending to next pipeline
2026-03-24 22:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785, identifier: 1980350
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970fc10>
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/2.jpg saved to cache
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839a7d0>
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/1.jpg saved to cache
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911a5d0>
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/3.jpg saved to cache
2026-03-24 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with identifier: 1980350
2026-03-24 22:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with identifier: 1980350
2026-03-24 22:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with identifier: 1980350 to the API
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 84566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785/ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/65f902e882c6400e8db81d121827fd29/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 AUTO ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980350%27 HTTP/1.1" 200 None
2026-03-24 22:52:17 [ayvens.be] INFO: Saving data for 1980350: {'created_time': 1774392737.946281, 'last_price_update_time': 1774392737.946291, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980350') HTTP/1.1" 204 0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/8.jpg not downloaded yet
2026-03-24 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/9.jpg not downloaded yet
2026-03-24 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083256d0>
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/5.jpg saved to cache
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/10.jpg not downloaded yet
2026-03-24 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:18 [ayvens.be] INFO: Found listing with ID: 1980353
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980353%27 HTTP/1.1" 200 None
2026-03-24 22:52:18 [ayvens.be] INFO: Scrape type for 1980353: 1
2026-03-24 22:52:18 [ayvens.be] INFO: Extracting data for car ID: 1980353
2026-03-24 22:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1980353
2026-03-24 22:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798116e5-b8de-5252-8955-1d1dbebba461 with scrape type 1
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/1.jpg not downloaded yet
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911a210>
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/4.jpg saved to cache
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838d10>
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/7.jpg saved to cache
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/2.jpg not downloaded yet
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835a210>
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/6.jpg saved to cache
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359690>
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/10.jpg saved to cache
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf4890>
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/9.jpg saved to cache
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a350>
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F66728cbfeb74441f889008a8228feab2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/8.jpg saved to cache
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0
2026-03-24 22:52:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6be1dc48-9840-50dc-ac8c-5bc670c797c0, skipping ID generation
2026-03-24 22:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with scrape type 1
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0 sending to next pipeline
2026-03-24 22:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6be1dc48-9840-50dc-ac8c-5bc670c797c0, identifier: 1980351
2026-03-24 22:52:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/3.jpg not downloaded yet
2026-03-24 22:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with identifier: 1980351
2026-03-24 22:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with identifier: 1980351
2026-03-24 22:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with identifier: 1980351 to the API
2026-03-24 22:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6be1dc48-9840-50dc-ac8c-5bc670c797c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 93435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1dc48-9840-50dc-ac8c-5bc670c797c0/6be1dc48-9840-50dc-ac8c-5bc670c797c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/66728cbfeb74441f889008a8228feab2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'vin': None,
 'year': 2020}
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980351%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [ayvens.be] INFO: Saving data for 1980351: {'created_time': 1774392739.233966, 'last_price_update_time': 1774392739.234015, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980351') HTTP/1.1" 204 0
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/4.jpg not downloaded yet
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/5.jpg not downloaded yet
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967df10>
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/1.jpg saved to cache
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/6.jpg not downloaded yet
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/7.jpg not downloaded yet
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/8.jpg not downloaded yet
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/9.jpg not downloaded yet
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/10.jpg not downloaded yet
2026-03-24 22:52:19 [ayvens.be] INFO: Found listing with ID: 1980354
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980354%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [ayvens.be] INFO: Scrape type for 1980354: 1
2026-03-24 22:52:19 [ayvens.be] INFO: Extracting data for car ID: 1980354
2026-03-24 22:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1980354
2026-03-24 22:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with scrape type 1
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/1.jpg not downloaded yet
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099407d0>
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/4.jpg saved to cache
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838fd0>
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/3.jpg saved to cache
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970f7d0>
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/5.jpg saved to cache
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc6cd0>
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/2.jpg saved to cache
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/2.jpg not downloaded yet
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeafb90>
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/6.jpg saved to cache
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/3.jpg not downloaded yet
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/4.jpg not downloaded yet
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910fb50>
2026-03-24 22:52:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/7.jpg saved to cache
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009011a90>
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/8.jpg saved to cache
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009459bd0>
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/9.jpg saved to cache
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/5.jpg not downloaded yet
2026-03-24 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/6.jpg not downloaded yet
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009177990>
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/1.jpg saved to cache
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187550>
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/4.jpg saved to cache
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a2590>
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/5.jpg saved to cache
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e990>
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/2.jpg saved to cache
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e890>
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/6.jpg saved to cache
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/7.jpg not downloaded yet
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/8.jpg not downloaded yet
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914e010>
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/3.jpg saved to cache
2026-03-24 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009860650>
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F83d0867b008d4e90a59a673bf0808b56%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/10.jpg saved to cache
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af974b1e-bc76-523e-80e0-698c29fe183c
2026-03-24 22:52:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af974b1e-bc76-523e-80e0-698c29fe183c, skipping ID generation
2026-03-24 22:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af974b1e-bc76-523e-80e0-698c29fe183c with scrape type 1
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af974b1e-bc76-523e-80e0-698c29fe183c sending to next pipeline
2026-03-24 22:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af974b1e-bc76-523e-80e0-698c29fe183c, identifier: 1980352
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb3550>
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/7.jpg saved to cache
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1980352
2026-03-24 22:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1980352
2026-03-24 22:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1980352 to the API
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'af974b1e-bc76-523e-80e0-698c29fe183c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'MULTIVAN LANG',
 'odometer': 75696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af974b1e-bc76-523e-80e0-698c29fe183c/af974b1e-bc76-523e-80e0-698c29fe183c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/83d0867b008d4e90a59a673bf0808b56/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN MULTIVAN LANG 1.4 EHYBRID PHEV DSG EXT STYLE',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID PHEV DSG EXT STYLE',
 'vin': None,
 'year': 2023}
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980352%27 HTTP/1.1" 200 None
2026-03-24 22:52:21 [ayvens.be] INFO: Saving data for 1980352: {'created_time': 1774392741.726216, 'last_price_update_time': 1774392741.726226, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980352') HTTP/1.1" 204 0
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/9.jpg not downloaded yet
2026-03-24 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/10.jpg not downloaded yet
2026-03-24 22:52:21 [ayvens.be] INFO: Found listing with ID: 1980355
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980355%27 HTTP/1.1" 200 None
2026-03-24 22:52:21 [ayvens.be] INFO: Scrape type for 1980355: 1
2026-03-24 22:52:21 [ayvens.be] INFO: Extracting data for car ID: 1980355
2026-03-24 22:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1980355
2026-03-24 22:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with scrape type 1
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/1.jpg not downloaded yet
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/2.jpg not downloaded yet
2026-03-24 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/3.jpg not downloaded yet
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/4.jpg not downloaded yet
2026-03-24 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962cd50>
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/10.jpg saved to cache
2026-03-24 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cbc90>
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/8.jpg saved to cache
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d250>
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xb%252Fab868328b1b94fc38d6433a2a64d93a6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/9.jpg saved to cache
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 798116e5-b8de-5252-8955-1d1dbebba461
2026-03-24 22:52:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 798116e5-b8de-5252-8955-1d1dbebba461, skipping ID generation
2026-03-24 22:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798116e5-b8de-5252-8955-1d1dbebba461 with scrape type 1
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 798116e5-b8de-5252-8955-1d1dbebba461 sending to next pipeline
2026-03-24 22:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 798116e5-b8de-5252-8955-1d1dbebba461, identifier: 1980353
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/5.jpg not downloaded yet
2026-03-24 22:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1980353
2026-03-24 22:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1980353
2026-03-24 22:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1980353 to the API
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '798116e5-b8de-5252-8955-1d1dbebba461',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 87053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798116e5-b8de-5252-8955-1d1dbebba461/798116e5-b8de-5252-8955-1d1dbebba461_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xb/ab868328b1b94fc38d6433a2a64d93a6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980353%27 HTTP/1.1" 200 None
2026-03-24 22:52:22 [ayvens.be] INFO: Saving data for 1980353: {'created_time': 1774392742.54808, 'last_price_update_time': 1774392742.54809, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980353') HTTP/1.1" 204 0
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/6.jpg not downloaded yet
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009862310>
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/1.jpg saved to cache
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009941f10>
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/2.jpg saved to cache
2026-03-24 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf7390>
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/3.jpg saved to cache
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009667d50>
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/4.jpg saved to cache
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b86d0>
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/5.jpg saved to cache
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/7.jpg not downloaded yet
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/8.jpg not downloaded yet
2026-03-24 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/9.jpg not downloaded yet
2026-03-24 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/10.jpg not downloaded yet
2026-03-24 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:23 [ayvens.be] INFO: Found listing with ID: 1980356
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980356%27 HTTP/1.1" 200 None
2026-03-24 22:52:23 [ayvens.be] INFO: Scrape type for 1980356: 1
2026-03-24 22:52:23 [ayvens.be] INFO: Extracting data for car ID: 1980356
2026-03-24 22:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1980356
2026-03-24 22:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with scrape type 1
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/1.jpg not downloaded yet
2026-03-24 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/2.jpg not downloaded yet
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/3.jpg not downloaded yet
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910f5d0>
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/6.jpg saved to cache
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442850>
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/7.jpg saved to cache
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083835d0>
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/1.jpg saved to cache
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/4.jpg not downloaded yet
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009147990>
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/2.jpg saved to cache
2026-03-24 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945d790>
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/10.jpg saved to cache
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/5.jpg not downloaded yet
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938d890>
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/3.jpg saved to cache
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916cd50>
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/8.jpg saved to cache
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1baf50>
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fa29ca5a9a0e34367bf1783c166d5bc51%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/9.jpg saved to cache
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4
2026-03-24 22:52:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4, skipping ID generation
2026-03-24 22:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with scrape type 1
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 sending to next pipeline
2026-03-24 22:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4, identifier: 1980354
2026-03-24 22:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1980354
2026-03-24 22:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1980354
2026-03-24 22:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1980354 to the API
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6235cf64-c13d-5557-9b9a-f84c9caa6fd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 105698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 998269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 928181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6235cf64-c13d-5557-9b9a-f84c9caa6fd4/6235cf64-c13d-5557-9b9a-f84c9caa6fd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/a29ca5a9a0e34367bf1783c166d5bc51/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 ALLURE',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 ALLURE',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980354%27 HTTP/1.1" 200 None
2026-03-24 22:52:24 [ayvens.be] INFO: Saving data for 1980354: {'created_time': 1774392744.848024, 'last_price_update_time': 1774392744.848035, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980354') HTTP/1.1" 204 0
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/6.jpg not downloaded yet
2026-03-24 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/7.jpg not downloaded yet
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/8.jpg not downloaded yet
2026-03-24 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/9.jpg not downloaded yet
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/10.jpg not downloaded yet
2026-03-24 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:24 [ayvens.be] INFO: Found listing with ID: 1980357
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980357%27 HTTP/1.1" 200 None
2026-03-24 22:52:24 [ayvens.be] INFO: Scrape type for 1980357: 1
2026-03-24 22:52:24 [ayvens.be] INFO: Extracting data for car ID: 1980357
2026-03-24 22:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1980357
2026-03-24 22:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d291316e-e7fb-5331-8027-e134326c102a with scrape type 1
2026-03-24 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/1.jpg not downloaded yet
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/2.jpg not downloaded yet
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a1d90>
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/5.jpg saved to cache
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094421d0>
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/4.jpg saved to cache
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343110>
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/7.jpg saved to cache
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372e90>
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/6.jpg saved to cache
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/3.jpg not downloaded yet
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/4.jpg not downloaded yet
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009465d50>
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/8.jpg saved to cache
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fb010>
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/9.jpg saved to cache
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093bb750>
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/3.jpg saved to cache
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009010cd0>
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fefe6da1ed59244159e23b6ddacb5cd1d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/10.jpg saved to cache
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f
2026-03-24 22:52:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f, skipping ID generation
2026-03-24 22:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with scrape type 1
2026-03-24 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f sending to next pipeline
2026-03-24 22:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f, identifier: 1980355
2026-03-24 22:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1980355
2026-03-24 22:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1980355
2026-03-24 22:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1980355 to the API
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '743ab5aa-3ca7-595a-9611-e0a7ffd4376f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 115975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 906392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743ab5aa-3ca7-595a-9611-e0a7ffd4376f/743ab5aa-3ca7-595a-9611-e0a7ffd4376f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 929849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/efe6da1ed59244159e23b6ddacb5cd1d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV CORE AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV CORE AUTO 4WD',
 'vin': None,
 'year': 2024}
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980355%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [ayvens.be] INFO: Saving data for 1980355: {'created_time': 1774392746.095592, 'last_price_update_time': 1774392746.095602, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980355') HTTP/1.1" 204 0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/5.jpg not downloaded yet
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/6.jpg not downloaded yet
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/7.jpg not downloaded yet
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/8.jpg not downloaded yet
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/9.jpg not downloaded yet
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/10.jpg not downloaded yet
2026-03-24 22:52:26 [ayvens.be] INFO: Found listing with ID: 1980358
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980358%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [ayvens.be] INFO: Scrape type for 1980358: 1
2026-03-24 22:52:26 [ayvens.be] INFO: Extracting data for car ID: 1980358
2026-03-24 22:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1980358
2026-03-24 22:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with scrape type 1
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/1.jpg not downloaded yet
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472e90>
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/5.jpg saved to cache
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917f7d0>
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/6.jpg saved to cache
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/2.jpg not downloaded yet
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a0ed0>
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/1.jpg saved to cache
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096de790>
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/4.jpg saved to cache
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bdb50>
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/2.jpg saved to cache
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096dee90>
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/7.jpg saved to cache
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/3.jpg not downloaded yet
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492050>
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/8.jpg saved to cache
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/4.jpg not downloaded yet
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/5.jpg not downloaded yet
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/6.jpg not downloaded yet
2026-03-24 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/7.jpg not downloaded yet
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/8.jpg not downloaded yet
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/9.jpg not downloaded yet
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/10.jpg not downloaded yet
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018050>
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/3.jpg saved to cache
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:27 [ayvens.be] INFO: Found listing with ID: 1980359
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980359%27 HTTP/1.1" 200 None
2026-03-24 22:52:27 [ayvens.be] INFO: Scrape type for 1980359: 1
2026-03-24 22:52:27 [ayvens.be] INFO: Extracting data for car ID: 1980359
2026-03-24 22:52:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1980359
2026-03-24 22:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with scrape type 1
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/1.jpg not downloaded yet
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008384710>
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/9.jpg saved to cache
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009395850>
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F4b843eb23c1e4fb1a819ab43b1bf5118%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/10.jpg saved to cache
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0
2026-03-24 22:52:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0, skipping ID generation
2026-03-24 22:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with scrape type 1
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 sending to next pipeline
2026-03-24 22:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0, identifier: 1980356
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096df6d0>
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/5.jpg saved to cache
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310050>
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/6.jpg saved to cache
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/2.jpg not downloaded yet
2026-03-24 22:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1980356
2026-03-24 22:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1980356
2026-03-24 22:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1980356 to the API
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '274ec52a-7bd4-5d37-b9e6-692b9194f3b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 107725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274ec52a-7bd4-5d37-b9e6-692b9194f3b0/274ec52a-7bd4-5d37-b9e6-692b9194f3b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/4b843eb23c1e4fb1a819ab43b1bf5118/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.5 BLUEHDI 130 S-S FEEL AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S-S FEEL AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980356%27 HTTP/1.1" 200 None
2026-03-24 22:52:28 [ayvens.be] INFO: Saving data for 1980356: {'created_time': 1774392748.058564, 'last_price_update_time': 1774392748.058575, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980356') HTTP/1.1" 204 0
2026-03-24 22:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/3.jpg not downloaded yet
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394d90>
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/4.jpg saved to cache
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347450>
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/2.jpg saved to cache
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110f10>
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/1.jpg saved to cache
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/4.jpg not downloaded yet
2026-03-24 22:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/5.jpg not downloaded yet
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb3b90>
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/7.jpg saved to cache
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/6.jpg not downloaded yet
2026-03-24 22:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/7.jpg not downloaded yet
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/8.jpg not downloaded yet
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a30d0>
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/10.jpg saved to cache
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964e810>
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/8.jpg saved to cache
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/9.jpg not downloaded yet
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/10.jpg not downloaded yet
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ccd50>
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/4.jpg saved to cache
2026-03-24 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405590>
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/2.jpg saved to cache
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019e10>
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/1.jpg saved to cache
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009941290>
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/3.jpg saved to cache
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442110>
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F919d0f9a00fa42e98a13b84e0dbf1d95%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/9.jpg saved to cache
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d291316e-e7fb-5331-8027-e134326c102a
2026-03-24 22:52:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d291316e-e7fb-5331-8027-e134326c102a, skipping ID generation
2026-03-24 22:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d291316e-e7fb-5331-8027-e134326c102a with scrape type 1
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d291316e-e7fb-5331-8027-e134326c102a sending to next pipeline
2026-03-24 22:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d291316e-e7fb-5331-8027-e134326c102a, identifier: 1980357
2026-03-24 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:29 [ayvens.be] INFO: Found listing with ID: 1980360
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980360%27 HTTP/1.1" 200 None
2026-03-24 22:52:29 [ayvens.be] INFO: Scrape type for 1980360: 1
2026-03-24 22:52:29 [ayvens.be] INFO: Extracting data for car ID: 1980360
2026-03-24 22:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1980360
2026-03-24 22:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a785095c-c896-5b3b-9fac-f87b2e173115 with scrape type 1
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/1.jpg not downloaded yet
2026-03-24 22:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1980357
2026-03-24 22:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1980357
2026-03-24 22:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1980357 to the API
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd291316e-e7fb-5331-8027-e134326c102a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 116540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d291316e-e7fb-5331-8027-e134326c102a/d291316e-e7fb-5331-8027-e134326c102a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/919d0f9a00fa42e98a13b84e0dbf1d95/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980357%27 HTTP/1.1" 200 None
2026-03-24 22:52:29 [ayvens.be] INFO: Saving data for 1980357: {'created_time': 1774392749.694034, 'last_price_update_time': 1774392749.694043, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980357') HTTP/1.1" 204 0
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/2.jpg not downloaded yet
2026-03-24 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/3.jpg not downloaded yet
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945ac10>
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/5.jpg saved to cache
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/4.jpg not downloaded yet
2026-03-24 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/5.jpg not downloaded yet
2026-03-24 22:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/6.jpg not downloaded yet
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970ec50>
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/1.jpg saved to cache
2026-03-24 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009129450>
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/10.jpg saved to cache
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b56dd0>
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/6.jpg saved to cache
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/7.jpg not downloaded yet
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/8.jpg not downloaded yet
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/9.jpg not downloaded yet
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf4810>
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/9.jpg saved to cache
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008342190>
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/2.jpg saved to cache
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009191450>
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/7.jpg saved to cache
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407f90>
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffd5b53b4947d44558829b3ea0152ecc2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/8.jpg saved to cache
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2
2026-03-24 22:52:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2, skipping ID generation
2026-03-24 22:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with scrape type 1
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 sending to next pipeline
2026-03-24 22:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2, identifier: 1980358
2026-03-24 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1980358
2026-03-24 22:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1980358
2026-03-24 22:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1980358 to the API
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '30779306-d801-5b7a-b9b1-8ea1ead4d1c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 106736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30779306-d801-5b7a-b9b1-8ea1ead4d1c2/30779306-d801-5b7a-b9b1-8ea1ead4d1c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/fd5b53b4947d44558829b3ea0152ecc2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus 1.0I ECOBOOST 74KW CONNECTED',
 'transmission': 'manual',
 'trim': '1.0I ECOBOOST 74KW CONNECTED',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980358%27 HTTP/1.1" 200 None
2026-03-24 22:52:30 [ayvens.be] INFO: Saving data for 1980358: {'created_time': 1774392750.914522, 'last_price_update_time': 1774392750.914531, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980358') HTTP/1.1" 204 0
2026-03-24 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/10.jpg not downloaded yet
2026-03-24 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:30 [ayvens.be] INFO: Found listing with ID: 1980361
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980361%27 HTTP/1.1" 200 None
2026-03-24 22:52:30 [ayvens.be] INFO: Scrape type for 1980361: 1
2026-03-24 22:52:30 [ayvens.be] INFO: Extracting data for car ID: 1980361
2026-03-24 22:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1980361
2026-03-24 22:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db4811c8-bd53-558b-b1fd-f2e5723c3231 with scrape type 1
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/1.jpg not downloaded yet
2026-03-24 22:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911d350>
2026-03-24 22:52:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/9.jpg saved to cache
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/2.jpg not downloaded yet
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/3.jpg not downloaded yet
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d97190>
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/4.jpg saved to cache
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cf2d0>
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/6.jpg saved to cache
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ba1d0>
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/3.jpg saved to cache
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e3250>
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/8.jpg saved to cache
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/4.jpg not downloaded yet
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970d890>
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/5.jpg saved to cache
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c650>
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/10.jpg saved to cache
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/5.jpg not downloaded yet
2026-03-24 22:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff017667bd0>
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252F61f07b6fa0ae4ec5a2d6e3cbca8e95af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/7.jpg saved to cache
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19
2026-03-24 22:52:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19, skipping ID generation
2026-03-24 22:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with scrape type 1
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 sending to next pipeline
2026-03-24 22:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19, identifier: 1980359
2026-03-24 22:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/6.jpg not downloaded yet
2026-03-24 22:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1980359
2026-03-24 22:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1980359
2026-03-24 22:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1980359 to the API
2026-03-24 22:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 100209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19/f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/61f07b6fa0ae4ec5a2d6e3cbca8e95af/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980359%27 HTTP/1.1" 200 None
2026-03-24 22:52:32 [ayvens.be] INFO: Saving data for 1980359: {'created_time': 1774392752.103249, 'last_price_update_time': 1774392752.10326, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980359') HTTP/1.1" 204 0
2026-03-24 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/7.jpg not downloaded yet
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834e450>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/6.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096649d0>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/4.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd350>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/3.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009491950>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/7.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970fa50>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/5.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018e90>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/1.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/8.jpg not downloaded yet
2026-03-24 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/9.jpg not downloaded yet
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ed310>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/2.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013310>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/8.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/10.jpg not downloaded yet
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009861ad0>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/9.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009791910>
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Fb4f092ba5ec14c598dcc95ecd80e06b4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/10.jpg saved to cache
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a785095c-c896-5b3b-9fac-f87b2e173115
2026-03-24 22:52:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a785095c-c896-5b3b-9fac-f87b2e173115, skipping ID generation
2026-03-24 22:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a785095c-c896-5b3b-9fac-f87b2e173115 with scrape type 1
2026-03-24 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a785095c-c896-5b3b-9fac-f87b2e173115 sending to next pipeline
2026-03-24 22:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a785095c-c896-5b3b-9fac-f87b2e173115, identifier: 1980360
2026-03-24 22:52:33 [ayvens.be] INFO: Found listing with ID: 1980362
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980362%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [ayvens.be] INFO: Scrape type for 1980362: 1
2026-03-24 22:52:33 [ayvens.be] INFO: Extracting data for car ID: 1980362
2026-03-24 22:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1980362
2026-03-24 22:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f4d39c-835f-57b7-985d-07092ee2af02 with scrape type 1
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/1.jpg not downloaded yet
2026-03-24 22:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1980360
2026-03-24 22:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1980360
2026-03-24 22:52:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1980360 to the API
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a785095c-c896-5b3b-9fac-f87b2e173115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 48154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a785095c-c896-5b3b-9fac-f87b2e173115/a785095c-c896-5b3b-9fac-f87b2e173115_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/b4f092ba5ec14c598dcc95ecd80e06b4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TSI 130 MOVE!',
 'transmission': 'manual',
 'trim': '1.5 TSI 130 MOVE!',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980360%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [ayvens.be] INFO: Saving data for 1980360: {'created_time': 1774392753.365472, 'last_price_update_time': 1774392753.365481, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980360') HTTP/1.1" 204 0
2026-03-24 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/2.jpg not downloaded yet
2026-03-24 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/3.jpg not downloaded yet
2026-03-24 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/4.jpg not downloaded yet
2026-03-24 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/5.jpg not downloaded yet
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/6.jpg not downloaded yet
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/7.jpg not downloaded yet
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009010890>
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/5.jpg saved to cache
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/8.jpg not downloaded yet
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009448e50>
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/6.jpg saved to cache
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fb510>
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/2.jpg saved to cache
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02ad0>
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/1.jpg saved to cache
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013f50>
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/4.jpg saved to cache
2026-03-24 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009421d10>
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/3.jpg saved to cache
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913cd50>
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/8.jpg saved to cache
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666f50>
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/7.jpg saved to cache
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/9.jpg not downloaded yet
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/10.jpg not downloaded yet
2026-03-24 22:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:34 [ayvens.be] INFO: Found listing with ID: 1980363
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980363%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [ayvens.be] INFO: Scrape type for 1980363: 1
2026-03-24 22:52:34 [ayvens.be] INFO: Extracting data for car ID: 1980363
2026-03-24 22:52:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1980363
2026-03-24 22:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a83606b-6a2f-5845-a171-3506d77c25a9 with scrape type 1
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/1.jpg not downloaded yet
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/2.jpg not downloaded yet
2026-03-24 22:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/3.jpg not downloaded yet
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/4.jpg not downloaded yet
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008312350>
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/9.jpg saved to cache
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/5.jpg not downloaded yet
2026-03-24 22:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/6.jpg not downloaded yet
2026-03-24 22:52:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/7.jpg not downloaded yet
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bdd50>
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/2.jpg saved to cache
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a1d10>
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/3.jpg saved to cache
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613550>
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F31950678d11b430ab19a950c87312fae%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/10.jpg saved to cache
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db4811c8-bd53-558b-b1fd-f2e5723c3231
2026-03-24 22:52:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db4811c8-bd53-558b-b1fd-f2e5723c3231, skipping ID generation
2026-03-24 22:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db4811c8-bd53-558b-b1fd-f2e5723c3231 with scrape type 1
2026-03-24 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db4811c8-bd53-558b-b1fd-f2e5723c3231 sending to next pipeline
2026-03-24 22:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: db4811c8-bd53-558b-b1fd-f2e5723c3231, identifier: 1980361
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121d90>
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/1.jpg saved to cache
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1980361
2026-03-24 22:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1980361
2026-03-24 22:52:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1980361 to the API
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'db4811c8-bd53-558b-b1fd-f2e5723c3231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 65895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db4811c8-bd53-558b-b1fd-f2e5723c3231/db4811c8-bd53-558b-b1fd-f2e5723c3231_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/31950678d11b430ab19a950c87312fae/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980361%27 HTTP/1.1" 200 None
2026-03-24 22:52:35 [ayvens.be] INFO: Saving data for 1980361: {'created_time': 1774392755.345032, 'last_price_update_time': 1774392755.345042, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980361') HTTP/1.1" 204 0
2026-03-24 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/8.jpg not downloaded yet
2026-03-24 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/9.jpg not downloaded yet
2026-03-24 22:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aafd0>
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/9.jpg saved to cache
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096869d0>
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/7.jpg saved to cache
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a3d50>
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/8.jpg saved to cache
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009458390>
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/5.jpg saved to cache
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/10.jpg not downloaded yet
2026-03-24 22:52:35 [ayvens.be] INFO: Found listing with ID: 1980364
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980364%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [ayvens.be] INFO: Scrape type for 1980364: 1
2026-03-24 22:52:36 [ayvens.be] INFO: Extracting data for car ID: 1980364
2026-03-24 22:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5e63bec-f144-5fda-a4ad-f8599f98ab51 with identifier: 1980364
2026-03-24 22:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e63bec-f144-5fda-a4ad-f8599f98ab51 with scrape type 1
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/1.jpg not downloaded yet
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009684a50>
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/4.jpg saved to cache
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009008c90>
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/6.jpg saved to cache
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec7550>
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F25b7982d16bd4ce6a18bd8b26bed4d8f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/10.jpg saved to cache
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7f4d39c-835f-57b7-985d-07092ee2af02
2026-03-24 22:52:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7f4d39c-835f-57b7-985d-07092ee2af02, skipping ID generation
2026-03-24 22:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f4d39c-835f-57b7-985d-07092ee2af02 with scrape type 1
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7f4d39c-835f-57b7-985d-07092ee2af02 sending to next pipeline
2026-03-24 22:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7f4d39c-835f-57b7-985d-07092ee2af02, identifier: 1980362
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119250>
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/1.jpg saved to cache
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1980362
2026-03-24 22:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1980362
2026-03-24 22:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1980362 to the API
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b7f4d39c-835f-57b7-985d-07092ee2af02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 56256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f4d39c-835f-57b7-985d-07092ee2af02/b7f4d39c-835f-57b7-985d-07092ee2af02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/25b7982d16bd4ce6a18bd8b26bed4d8f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980362%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [ayvens.be] INFO: Saving data for 1980362: {'created_time': 1774392756.7238, 'last_price_update_time': 1774392756.72381, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980362') HTTP/1.1" 204 0
2026-03-24 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/2.jpg not downloaded yet
2026-03-24 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/3.jpg not downloaded yet
2026-03-24 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/4.jpg not downloaded yet
2026-03-24 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/5.jpg not downloaded yet
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/6.jpg not downloaded yet
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/7.jpg not downloaded yet
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915cd50>
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/2.jpg saved to cache
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/8.jpg not downloaded yet
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ab710>
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/6.jpg saved to cache
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093dbb90>
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/3.jpg saved to cache
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009793090>
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/5.jpg saved to cache
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/9.jpg not downloaded yet
2026-03-24 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/10.jpg not downloaded yet
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b8e90>
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/7.jpg saved to cache
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3510>
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/8.jpg saved to cache
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838dcd0>
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/9.jpg saved to cache
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00919a610>
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/4.jpg saved to cache
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:37 [ayvens.be] INFO: Found listing with ID: 1980365
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980365%27 HTTP/1.1" 200 None
2026-03-24 22:52:37 [ayvens.be] INFO: Scrape type for 1980365: 1
2026-03-24 22:52:37 [ayvens.be] INFO: Extracting data for car ID: 1980365
2026-03-24 22:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1980365
2026-03-24 22:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99e8d78-c155-5dae-996d-4af8f0bf5beb with scrape type 1
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/1.jpg not downloaded yet
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8150>
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/2.jpg saved to cache
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009420690>
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F057e989a4a9a428491d2051d2f6c4c2a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/10.jpg saved to cache
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a83606b-6a2f-5845-a171-3506d77c25a9
2026-03-24 22:52:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a83606b-6a2f-5845-a171-3506d77c25a9, skipping ID generation
2026-03-24 22:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a83606b-6a2f-5845-a171-3506d77c25a9 with scrape type 1
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a83606b-6a2f-5845-a171-3506d77c25a9 sending to next pipeline
2026-03-24 22:52:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a83606b-6a2f-5845-a171-3506d77c25a9, identifier: 1980363
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/2.jpg not downloaded yet
2026-03-24 22:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1980363
2026-03-24 22:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1980363
2026-03-24 22:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1980363 to the API
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '1a83606b-6a2f-5845-a171-3506d77c25a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 106366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83606b-6a2f-5845-a171-3506d77c25a9/1a83606b-6a2f-5845-a171-3506d77c25a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/057e989a4a9a428491d2051d2f6c4c2a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 2.0 CRTDI 110KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 CLEVER',
 'vin': None,
 'year': 2023}
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980363%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [ayvens.be] INFO: Saving data for 1980363: {'created_time': 1774392758.227314, 'last_price_update_time': 1774392758.227324, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980363') HTTP/1.1" 204 0
2026-03-24 22:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/3.jpg not downloaded yet
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664810>
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/1.jpg saved to cache
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b250>
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/4.jpg saved to cache
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915c310>
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/3.jpg saved to cache
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7c50>
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/5.jpg saved to cache
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095658d0>
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/6.jpg saved to cache
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/4.jpg not downloaded yet
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008308cd0>
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/7.jpg saved to cache
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/5.jpg not downloaded yet
2026-03-24 22:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/6.jpg not downloaded yet
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/7.jpg not downloaded yet
2026-03-24 22:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/8.jpg not downloaded yet
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/9.jpg not downloaded yet
2026-03-24 22:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/10.jpg not downloaded yet
2026-03-24 22:52:38 [ayvens.be] INFO: Found listing with ID: 1980366
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980366%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [ayvens.be] INFO: Scrape type for 1980366: 1
2026-03-24 22:52:38 [ayvens.be] INFO: Extracting data for car ID: 1980366
2026-03-24 22:52:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1980366
2026-03-24 22:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with scrape type 1
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/1.jpg not downloaded yet
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838e1d0>
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/9.jpg saved to cache
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097627d0>
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/8.jpg saved to cache
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/2.jpg not downloaded yet
2026-03-24 22:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/3.jpg not downloaded yet
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009611210>
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Ffbfcb0438e24481795eb50597204aeab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/10.jpg saved to cache
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5e63bec-f144-5fda-a4ad-f8599f98ab51
2026-03-24 22:52:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5e63bec-f144-5fda-a4ad-f8599f98ab51, skipping ID generation
2026-03-24 22:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e63bec-f144-5fda-a4ad-f8599f98ab51 with scrape type 1
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5e63bec-f144-5fda-a4ad-f8599f98ab51 sending to next pipeline
2026-03-24 22:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5e63bec-f144-5fda-a4ad-f8599f98ab51, identifier: 1980364
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1a8c50>
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/1.jpg saved to cache
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008316b10>
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/2.jpg saved to cache
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5e63bec-f144-5fda-a4ad-f8599f98ab51 with identifier: 1980364
2026-03-24 22:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5e63bec-f144-5fda-a4ad-f8599f98ab51 with identifier: 1980364
2026-03-24 22:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5e63bec-f144-5fda-a4ad-f8599f98ab51 with identifier: 1980364 to the API
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e5e63bec-f144-5fda-a4ad-f8599f98ab51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 49652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5e63bec-f144-5fda-a4ad-f8599f98ab51/e5e63bec-f144-5fda-a4ad-f8599f98ab51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/fbfcb0438e24481795eb50597204aeab/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 ROADTRIP',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 ROADTRIP',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980364%27 HTTP/1.1" 200 None
2026-03-24 22:52:39 [ayvens.be] INFO: Saving data for 1980364: {'created_time': 1774392759.815599, 'last_price_update_time': 1774392759.815614, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980364') HTTP/1.1" 204 0
2026-03-24 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/4.jpg not downloaded yet
2026-03-24 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/5.jpg not downloaded yet
2026-03-24 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/6.jpg not downloaded yet
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/7.jpg not downloaded yet
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/8.jpg not downloaded yet
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/9.jpg not downloaded yet
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/10.jpg not downloaded yet
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873510>
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/6.jpg saved to cache
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317750>
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/9.jpg saved to cache
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009443e50>
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/4.jpg saved to cache
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836b750>
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/7.jpg saved to cache
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094075d0>
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/5.jpg saved to cache
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:40 [ayvens.be] INFO: Found listing with ID: 1980367
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980367%27 HTTP/1.1" 200 None
2026-03-24 22:52:40 [ayvens.be] INFO: Scrape type for 1980367: 1
2026-03-24 22:52:40 [ayvens.be] INFO: Extracting data for car ID: 1980367
2026-03-24 22:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1980367
2026-03-24 22:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with scrape type 1
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/1.jpg not downloaded yet
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0050>
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/8.jpg saved to cache
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/2.jpg not downloaded yet
2026-03-24 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/3.jpg not downloaded yet
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009458910>
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/3.jpg saved to cache
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685cd0>
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F80078049c3ce4275a7028ef13ffecad8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/10.jpg saved to cache
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d99e8d78-c155-5dae-996d-4af8f0bf5beb
2026-03-24 22:52:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d99e8d78-c155-5dae-996d-4af8f0bf5beb, skipping ID generation
2026-03-24 22:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99e8d78-c155-5dae-996d-4af8f0bf5beb with scrape type 1
2026-03-24 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d99e8d78-c155-5dae-996d-4af8f0bf5beb sending to next pipeline
2026-03-24 22:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d99e8d78-c155-5dae-996d-4af8f0bf5beb, identifier: 1980365
2026-03-24 22:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1980365
2026-03-24 22:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1980365
2026-03-24 22:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1980365 to the API
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd99e8d78-c155-5dae-996d-4af8f0bf5beb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 120860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d99e8d78-c155-5dae-996d-4af8f0bf5beb/d99e8d78-c155-5dae-996d-4af8f0bf5beb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/80078049c3ce4275a7028ef13ffecad8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980365%27 HTTP/1.1" 200 None
2026-03-24 22:52:41 [ayvens.be] INFO: Saving data for 1980365: {'created_time': 1774392761.090752, 'last_price_update_time': 1774392761.090762, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980365') HTTP/1.1" 204 0
2026-03-24 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/4.jpg not downloaded yet
2026-03-24 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009443890>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/2.jpg saved to cache
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9610>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/1.jpg saved to cache
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b7cd750>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/5.jpg saved to cache
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f8050>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/6.jpg saved to cache
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/5.jpg not downloaded yet
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096debd0>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/3.jpg saved to cache
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/6.jpg not downloaded yet
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096dee10>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/7.jpg saved to cache
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009192b90>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/8.jpg saved to cache
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2b50>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/4.jpg saved to cache
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/7.jpg not downloaded yet
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a990>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/10.jpg saved to cache
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/8.jpg not downloaded yet
2026-03-24 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/9.jpg not downloaded yet
2026-03-24 22:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/10.jpg not downloaded yet
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449010>
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F2f8185a8a1a44c0aad4eba6c0c2925be%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/9.jpg saved to cache
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc
2026-03-24 22:52:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc, skipping ID generation
2026-03-24 22:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with scrape type 1
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc sending to next pipeline
2026-03-24 22:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc, identifier: 1980366
2026-03-24 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:42 [ayvens.be] INFO: Found listing with ID: 1980368
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980368%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [ayvens.be] INFO: Scrape type for 1980368: 1
2026-03-24 22:52:42 [ayvens.be] INFO: Extracting data for car ID: 1980368
2026-03-24 22:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1980368
2026-03-24 22:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc82ec7-e1b1-591a-80b6-4f56857b498c with scrape type 1
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/1.jpg not downloaded yet
2026-03-24 22:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1980366
2026-03-24 22:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1980366
2026-03-24 22:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1980366 to the API
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '67ef6410-cbdb-5f79-bd50-4d8fb92361cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 20688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67ef6410-cbdb-5f79-bd50-4d8fb92361cc/67ef6410-cbdb-5f79-bd50-4d8fb92361cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/2f8185a8a1a44c0aad4eba6c0c2925be/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'transmission': 'automatic',
 'trim': 'BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980366%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [ayvens.be] INFO: Saving data for 1980366: {'created_time': 1774392762.481229, 'last_price_update_time': 1774392762.481239, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980366') HTTP/1.1" 204 0
2026-03-24 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/2.jpg not downloaded yet
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083254d0>
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/1.jpg saved to cache
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009567850>
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/2.jpg saved to cache
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e1010>
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/4.jpg saved to cache
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/3.jpg not downloaded yet
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/4.jpg not downloaded yet
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4d10>
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/3.jpg saved to cache
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/5.jpg not downloaded yet
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/6.jpg not downloaded yet
2026-03-24 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/7.jpg not downloaded yet
2026-03-24 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/8.jpg not downloaded yet
2026-03-24 22:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/9.jpg not downloaded yet
2026-03-24 22:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/10.jpg not downloaded yet
2026-03-24 22:52:43 [ayvens.be] INFO: Found listing with ID: 1980369
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980369%27 HTTP/1.1" 200 None
2026-03-24 22:52:43 [ayvens.be] INFO: Scrape type for 1980369: 1
2026-03-24 22:52:43 [ayvens.be] INFO: Extracting data for car ID: 1980369
2026-03-24 22:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1980369
2026-03-24 22:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807845ce-938b-5149-aef8-3b7658af3e71 with scrape type 1
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/1.jpg not downloaded yet
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009465010>
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/5.jpg saved to cache
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/2.jpg not downloaded yet
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009396890>
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/7.jpg saved to cache
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830ba90>
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/6.jpg saved to cache
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/3.jpg not downloaded yet
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/4.jpg not downloaded yet
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009459810>
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/8.jpg saved to cache
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834e250>
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/1.jpg saved to cache
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00833a050>
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/9.jpg saved to cache
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978a710>
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F3099fbd019b247aab8c63a0d76ea91c0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/10.jpg saved to cache
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d
2026-03-24 22:52:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d, skipping ID generation
2026-03-24 22:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with scrape type 1
2026-03-24 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d sending to next pipeline
2026-03-24 22:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d, identifier: 1980367
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfe1d0>
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/2.jpg saved to cache
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1980367
2026-03-24 22:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1980367
2026-03-24 22:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1980367 to the API
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '14f2b002-b2a6-542d-8ece-7cf9f9bede1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 179692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f2b002-b2a6-542d-8ece-7cf9f9bede1d/14f2b002-b2a6-542d-8ece-7cf9f9bede1d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 822239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/3099fbd019b247aab8c63a0d76ea91c0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 B4 D MHEV ULTIMATE BRIGHT AUTO',
 'transmission': 'automatic',
 'trim': '2.0 B4 D MHEV ULTIMATE BRIGHT AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980367%27 HTTP/1.1" 200 None
2026-03-24 22:52:44 [ayvens.be] INFO: Saving data for 1980367: {'created_time': 1774392764.359146, 'last_price_update_time': 1774392764.35916, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980367') HTTP/1.1" 204 0
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/5.jpg not downloaded yet
2026-03-24 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/6.jpg not downloaded yet
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008c93dd0>
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/6.jpg saved to cache
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4250>
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/5.jpg saved to cache
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/7.jpg not downloaded yet
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/8.jpg not downloaded yet
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/9.jpg not downloaded yet
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405ed0>
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/7.jpg saved to cache
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009640b50>
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/4.jpg saved to cache
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009642bd0>
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/3.jpg saved to cache
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/10.jpg not downloaded yet
2026-03-24 22:52:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:44 [ayvens.be] INFO: Found listing with ID: 1980370
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980370%27 HTTP/1.1" 200 None
2026-03-24 22:52:44 [ayvens.be] INFO: Scrape type for 1980370: 1
2026-03-24 22:52:44 [ayvens.be] INFO: Extracting data for car ID: 1980370
2026-03-24 22:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1980370
2026-03-24 22:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with scrape type 1
2026-03-24 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/1.jpg not downloaded yet
2026-03-24 22:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/2.jpg not downloaded yet
2026-03-24 22:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/3.jpg not downloaded yet
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970d110>
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/10.jpg saved to cache
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008398050>
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/9.jpg saved to cache
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/4.jpg not downloaded yet
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a7a50>
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc60d0ad5a6864d2da0b181c723265539%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/8.jpg saved to cache
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffc82ec7-e1b1-591a-80b6-4f56857b498c
2026-03-24 22:52:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffc82ec7-e1b1-591a-80b6-4f56857b498c, skipping ID generation
2026-03-24 22:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc82ec7-e1b1-591a-80b6-4f56857b498c with scrape type 1
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffc82ec7-e1b1-591a-80b6-4f56857b498c sending to next pipeline
2026-03-24 22:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ffc82ec7-e1b1-591a-80b6-4f56857b498c, identifier: 1980368
2026-03-24 22:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1980368
2026-03-24 22:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1980368
2026-03-24 22:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1980368 to the API
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ffc82ec7-e1b1-591a-80b6-4f56857b498c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT GTE - 2020',
 'odometer': 149760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc82ec7-e1b1-591a-80b6-4f56857b498c/ffc82ec7-e1b1-591a-80b6-4f56857b498c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c60d0ad5a6864d2da0b181c723265539/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT GTE - 2020 1.4 TSI PHEV GTE Business DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV GTE Business DSG',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980368%27 HTTP/1.1" 200 None
2026-03-24 22:52:45 [ayvens.be] INFO: Saving data for 1980368: {'created_time': 1774392765.874915, 'last_price_update_time': 1774392765.874924, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980368') HTTP/1.1" 204 0
2026-03-24 22:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/5.jpg not downloaded yet
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083345d0>
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/3.jpg saved to cache
2026-03-24 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916f690>
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/2.jpg saved to cache
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345350>
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/1.jpg saved to cache
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/6.jpg not downloaded yet
2026-03-24 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009718b90>
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/5.jpg saved to cache
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/7.jpg not downloaded yet
2026-03-24 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/8.jpg not downloaded yet
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971bb90>
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/4.jpg saved to cache
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/9.jpg not downloaded yet
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009612fd0>
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/6.jpg saved to cache
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/10.jpg not downloaded yet
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915fed0>
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/9.jpg saved to cache
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00919a210>
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/8.jpg saved to cache
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009199350>
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/7.jpg saved to cache
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971b7d0>
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/1.jpg saved to cache
2026-03-24 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:46 [ayvens.be] INFO: Found listing with ID: 1980371
2026-03-24 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980371%27 HTTP/1.1" 200 None
2026-03-24 22:52:47 [ayvens.be] INFO: Scrape type for 1980371: 1
2026-03-24 22:52:47 [ayvens.be] INFO: Extracting data for car ID: 1980371
2026-03-24 22:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1980371
2026-03-24 22:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d with scrape type 1
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/1.jpg not downloaded yet
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/2.jpg not downloaded yet
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009186150>
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fed718c8920394a0ea54edf0064dfe2e9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/10.jpg saved to cache
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 807845ce-938b-5149-aef8-3b7658af3e71
2026-03-24 22:52:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 807845ce-938b-5149-aef8-3b7658af3e71, skipping ID generation
2026-03-24 22:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807845ce-938b-5149-aef8-3b7658af3e71 with scrape type 1
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 807845ce-938b-5149-aef8-3b7658af3e71 sending to next pipeline
2026-03-24 22:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 807845ce-938b-5149-aef8-3b7658af3e71, identifier: 1980369
2026-03-24 22:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1980369
2026-03-24 22:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1980369
2026-03-24 22:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1980369 to the API
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '807845ce-938b-5149-aef8-3b7658af3e71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 74611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_807845ce-938b-5149-aef8-3b7658af3e71/807845ce-938b-5149-aef8-3b7658af3e71_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ed718c8920394a0ea54edf0064dfe2e9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW TITANIUM AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980369%27 HTTP/1.1" 200 None
2026-03-24 22:52:47 [ayvens.be] INFO: Saving data for 1980369: {'created_time': 1774392767.560011, 'last_price_update_time': 1774392767.560021, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980369') HTTP/1.1" 204 0
2026-03-24 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/3.jpg not downloaded yet
2026-03-24 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/4.jpg not downloaded yet
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964f910>
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/2.jpg saved to cache
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/5.jpg not downloaded yet
2026-03-24 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/6.jpg not downloaded yet
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317c50>
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/3.jpg saved to cache
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/7.jpg not downloaded yet
2026-03-24 22:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7110>
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/4.jpg saved to cache
2026-03-24 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec5fd0>
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/5.jpg saved to cache
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083143d0>
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/6.jpg saved to cache
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610310>
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/10.jpg saved to cache
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/8.jpg not downloaded yet
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/9.jpg not downloaded yet
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347190>
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/7.jpg saved to cache
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666150>
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/8.jpg saved to cache
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013310>
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F394596cf143949a999d61c2a7c67db63%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/9.jpg saved to cache
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417
2026-03-24 22:52:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417, skipping ID generation
2026-03-24 22:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with scrape type 1
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 sending to next pipeline
2026-03-24 22:52:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417, identifier: 1980370
2026-03-24 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1980370
2026-03-24 22:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1980370
2026-03-24 22:52:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1980370 to the API
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b8c7c7c-c02d-5ba0-acb4-cd5073322417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 43166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b8c7c7c-c02d-5ba0-acb4-cd5073322417/1b8c7c7c-c02d-5ba0-acb4-cd5073322417_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/394596cf143949a999d61c2a7c67db63/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980370%27 HTTP/1.1" 200 None
2026-03-24 22:52:48 [ayvens.be] INFO: Saving data for 1980370: {'created_time': 1774392768.946132, 'last_price_update_time': 1774392768.946141, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980370') HTTP/1.1" 204 0
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/10.jpg not downloaded yet
2026-03-24 22:52:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [ayvens.be] INFO: Found listing with ID: 1980372
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980372%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [ayvens.be] INFO: Scrape type for 1980372: 1
2026-03-24 22:52:49 [ayvens.be] INFO: Extracting data for car ID: 1980372
2026-03-24 22:52:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1980372
2026-03-24 22:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with scrape type 1
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/1.jpg not downloaded yet
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964d4d0>
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/1.jpg saved to cache
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/2.jpg not downloaded yet
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/3.jpg not downloaded yet
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0090>
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/3.jpg saved to cache
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083abd10>
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/2.jpg saved to cache
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/4.jpg not downloaded yet
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/5.jpg not downloaded yet
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fbb10>
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/5.jpg saved to cache
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc4a50>
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/4.jpg saved to cache
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/6.jpg not downloaded yet
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/7.jpg not downloaded yet
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a1f50>
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/7.jpg saved to cache
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2d10>
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/6.jpg saved to cache
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/8.jpg not downloaded yet
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/9.jpg not downloaded yet
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a9250>
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/9.jpg saved to cache
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/10.jpg not downloaded yet
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [ayvens.be] INFO: Found listing with ID: 1980373
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980373%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [ayvens.be] INFO: Scrape type for 1980373: 1
2026-03-24 22:52:49 [ayvens.be] INFO: Extracting data for car ID: 1980373
2026-03-24 22:52:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1980373
2026-03-24 22:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c31b26-dc78-56c7-b825-76271aa2099c with scrape type 1
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/1.jpg not downloaded yet
2026-03-24 22:52:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442750>
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/8.jpg saved to cache
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c87d0>
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F8ce458b217774c8797abc00fd9e011f1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/10.jpg saved to cache
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d
2026-03-24 22:52:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b68131d5-3bb8-563a-a9f7-13cf7d85e87d, skipping ID generation
2026-03-24 22:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d with scrape type 1
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d sending to next pipeline
2026-03-24 22:52:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b68131d5-3bb8-563a-a9f7-13cf7d85e87d, identifier: 1980371
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/2.jpg not downloaded yet
2026-03-24 22:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1980371
2026-03-24 22:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1980371
2026-03-24 22:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1980371 to the API
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b68131d5-3bb8-563a-a9f7-13cf7d85e87d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 173866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68131d5-3bb8-563a-a9f7-13cf7d85e87d/b68131d5-3bb8-563a-a9f7-13cf7d85e87d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/8ce458b217774c8797abc00fd9e011f1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2020}
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980371%27 HTTP/1.1" 200 None
2026-03-24 22:52:50 [ayvens.be] INFO: Saving data for 1980371: {'created_time': 1774392770.526023, 'last_price_update_time': 1774392770.526032, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980371') HTTP/1.1" 204 0
2026-03-24 22:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/3.jpg not downloaded yet
2026-03-24 22:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1890>
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/1.jpg saved to cache
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910f090>
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/2.jpg saved to cache
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664410>
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/3.jpg saved to cache
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/4.jpg not downloaded yet
2026-03-24 22:52:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/5.jpg not downloaded yet
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093bb610>
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/4.jpg saved to cache
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009177190>
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/5.jpg saved to cache
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/6.jpg not downloaded yet
2026-03-24 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/7.jpg not downloaded yet
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c01d0>
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/6.jpg saved to cache
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009860a50>
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/7.jpg saved to cache
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/8.jpg not downloaded yet
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/9.jpg not downloaded yet
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d01410>
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/8.jpg saved to cache
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bc210>
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/10.jpg saved to cache
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b390>
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Feb0018cbe27245069afc80686ab684ca%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/9.jpg saved to cache
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1
2026-03-24 22:52:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1, skipping ID generation
2026-03-24 22:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with scrape type 1
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 sending to next pipeline
2026-03-24 22:52:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1, identifier: 1980372
2026-03-24 22:52:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/10.jpg not downloaded yet
2026-03-24 22:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1980372
2026-03-24 22:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1980372
2026-03-24 22:52:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1980372 to the API
2026-03-24 22:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3c226416-0ac9-5e76-b8df-1e2ae4911fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 31143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c226416-0ac9-5e76-b8df-1e2ae4911fb1/3c226416-0ac9-5e76-b8df-1e2ae4911fb1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/eb0018cbe27245069afc80686ab684ca/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980372%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [ayvens.be] INFO: Saving data for 1980372: {'created_time': 1774392772.14162, 'last_price_update_time': 1774392772.14163, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980372') HTTP/1.1" 204 0
2026-03-24 22:52:52 [ayvens.be] INFO: Found listing with ID: 1980374
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980374%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [ayvens.be] INFO: Scrape type for 1980374: 1
2026-03-24 22:52:52 [ayvens.be] INFO: Extracting data for car ID: 1980374
2026-03-24 22:52:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d51ddfea-de2d-531f-a5db-5fc648154b9b with identifier: 1980374
2026-03-24 22:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d51ddfea-de2d-531f-a5db-5fc648154b9b with scrape type 1
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/1.jpg not downloaded yet
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/2.jpg not downloaded yet
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d9f10>
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/1.jpg saved to cache
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/3.jpg not downloaded yet
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/4.jpg not downloaded yet
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/5.jpg not downloaded yet
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc58d0>
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/2.jpg saved to cache
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8bd0>
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/3.jpg saved to cache
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/6.jpg not downloaded yet
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/7.jpg not downloaded yet
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009862c10>
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/4.jpg saved to cache
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382e50>
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/5.jpg saved to cache
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449890>
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/6.jpg saved to cache
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d810>
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/7.jpg saved to cache
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/8.jpg not downloaded yet
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/9.jpg not downloaded yet
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a1950>
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/8.jpg saved to cache
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/10.jpg not downloaded yet
2026-03-24 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:53 [ayvens.be] INFO: Found listing with ID: 1980375
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980375%27 HTTP/1.1" 200 None
2026-03-24 22:52:53 [ayvens.be] INFO: Scrape type for 1980375: 1
2026-03-24 22:52:53 [ayvens.be] INFO: Extracting data for car ID: 1980375
2026-03-24 22:52:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7efce468-dcf5-5358-b2a5-0e8924f61b90 with identifier: 1980375
2026-03-24 22:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7efce468-dcf5-5358-b2a5-0e8924f61b90 with scrape type 1
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/1.jpg not downloaded yet
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872fd0>
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/1.jpg saved to cache
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338dd0>
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/9.jpg saved to cache
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009665550>
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/2.jpg saved to cache
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/2.jpg not downloaded yet
2026-03-24 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/3.jpg not downloaded yet
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338c50>
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/3.jpg saved to cache
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3e10>
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/4.jpg saved to cache
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970e850>
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/5.jpg saved to cache
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/4.jpg not downloaded yet
2026-03-24 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8150>
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/6.jpg saved to cache
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/5.jpg not downloaded yet
2026-03-24 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/6.jpg not downloaded yet
2026-03-24 22:52:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a38d0>
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7807c9e166ce4addb7c3e94e79418afe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/10.jpg saved to cache
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9c31b26-dc78-56c7-b825-76271aa2099c
2026-03-24 22:52:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9c31b26-dc78-56c7-b825-76271aa2099c, skipping ID generation
2026-03-24 22:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c31b26-dc78-56c7-b825-76271aa2099c with scrape type 1
2026-03-24 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9c31b26-dc78-56c7-b825-76271aa2099c sending to next pipeline
2026-03-24 22:52:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c9c31b26-dc78-56c7-b825-76271aa2099c, identifier: 1980373
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2110>
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/7.jpg saved to cache
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bfa50>
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/9.jpg saved to cache
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/7.jpg not downloaded yet
2026-03-24 22:52:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1980373
2026-03-24 22:52:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1980373
2026-03-24 22:52:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1980373 to the API
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c9c31b26-dc78-56c7-b825-76271aa2099c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 131190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c31b26-dc78-56c7-b825-76271aa2099c/c9c31b26-dc78-56c7-b825-76271aa2099c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7807c9e166ce4addb7c3e94e79418afe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980373%27 HTTP/1.1" 200 None
2026-03-24 22:52:54 [ayvens.be] INFO: Saving data for 1980373: {'created_time': 1774392774.466551, 'last_price_update_time': 1774392774.466561, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980373') HTTP/1.1" 204 0
2026-03-24 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/8.jpg not downloaded yet
2026-03-24 22:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091995d0>
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/8.jpg saved to cache
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009113050>
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252Fb85a677846b94d8782042e0a7f538fda%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/10.jpg saved to cache
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d51ddfea-de2d-531f-a5db-5fc648154b9b
2026-03-24 22:52:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d51ddfea-de2d-531f-a5db-5fc648154b9b, skipping ID generation
2026-03-24 22:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d51ddfea-de2d-531f-a5db-5fc648154b9b with scrape type 1
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d51ddfea-de2d-531f-a5db-5fc648154b9b sending to next pipeline
2026-03-24 22:52:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d51ddfea-de2d-531f-a5db-5fc648154b9b, identifier: 1980374
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/9.jpg not downloaded yet
2026-03-24 22:52:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d51ddfea-de2d-531f-a5db-5fc648154b9b with identifier: 1980374
2026-03-24 22:52:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:52:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d51ddfea-de2d-531f-a5db-5fc648154b9b with identifier: 1980374
2026-03-24 22:52:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d51ddfea-de2d-531f-a5db-5fc648154b9b with identifier: 1980374 to the API
2026-03-24 22:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'DENIMBLAUW',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd51ddfea-de2d-531f-a5db-5fc648154b9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A SEDAN DIESEL (V177)',
 'odometer': 105843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51ddfea-de2d-531f-a5db-5fc648154b9b/d51ddfea-de2d-531f-a5db-5fc648154b9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/b85a677846b94d8782042e0a7f538fda/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A SEDAN DIESEL (V177) A 180 d Business Solution',
 'transmission': 'manual',
 'trim': 'A 180 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980374%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [ayvens.be] INFO: Saving data for 1980374: {'created_time': 1774392775.152654, 'last_price_update_time': 1774392775.152664, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980374') HTTP/1.1" 204 0
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/10.jpg not downloaded yet
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175e50>
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/1.jpg saved to cache
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971bc10>
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/2.jpg saved to cache
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:55 [ayvens.be] INFO: Found listing with ID: 1980376
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980376%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [ayvens.be] INFO: Scrape type for 1980376: 1
2026-03-24 22:52:55 [ayvens.be] INFO: Extracting data for car ID: 1980376
2026-03-24 22:52:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1980376
2026-03-24 22:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e with scrape type 1
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/1.jpg not downloaded yet
2026-03-24 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/2.jpg not downloaded yet
2026-03-24 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/3.jpg not downloaded yet
2026-03-24 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/4.jpg not downloaded yet
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/5.jpg not downloaded yet
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964fd10>
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/3.jpg saved to cache
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083abe10>
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/4.jpg saved to cache
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/6.jpg not downloaded yet
2026-03-24 22:52:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/7.jpg not downloaded yet
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008342190>
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/6.jpg saved to cache
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b92d0>
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/5.jpg saved to cache
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944a3d0>
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/8.jpg saved to cache
2026-03-24 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2750>
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/7.jpg saved to cache
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/8.jpg not downloaded yet
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/9.jpg not downloaded yet
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008339010>
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/9.jpg saved to cache
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c67d0>
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F26f75db85c7a4eed8ce2f71534d83e60%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/10.jpg saved to cache
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7efce468-dcf5-5358-b2a5-0e8924f61b90
2026-03-24 22:52:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7efce468-dcf5-5358-b2a5-0e8924f61b90, skipping ID generation
2026-03-24 22:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7efce468-dcf5-5358-b2a5-0e8924f61b90 with scrape type 1
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7efce468-dcf5-5358-b2a5-0e8924f61b90 sending to next pipeline
2026-03-24 22:52:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7efce468-dcf5-5358-b2a5-0e8924f61b90, identifier: 1980375
2026-03-24 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7efce468-dcf5-5358-b2a5-0e8924f61b90 with identifier: 1980375
2026-03-24 22:52:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7efce468-dcf5-5358-b2a5-0e8924f61b90 with identifier: 1980375
2026-03-24 22:52:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7efce468-dcf5-5358-b2a5-0e8924f61b90 with identifier: 1980375 to the API
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7efce468-dcf5-5358-b2a5-0e8924f61b90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 50270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7efce468-dcf5-5358-b2a5-0e8924f61b90/7efce468-dcf5-5358-b2a5-0e8924f61b90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/26f75db85c7a4eed8ce2f71534d83e60/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980375%27 HTTP/1.1" 200 None
2026-03-24 22:52:56 [ayvens.be] INFO: Saving data for 1980375: {'created_time': 1774392776.656777, 'last_price_update_time': 1774392776.656789, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980375') HTTP/1.1" 204 0
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/10.jpg not downloaded yet
2026-03-24 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:56 [ayvens.be] INFO: Found listing with ID: 1980377
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980377%27 HTTP/1.1" 200 None
2026-03-24 22:52:56 [ayvens.be] INFO: Scrape type for 1980377: 1
2026-03-24 22:52:56 [ayvens.be] INFO: Extracting data for car ID: 1980377
2026-03-24 22:52:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with identifier: 1980377
2026-03-24 22:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with scrape type 1
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/1.jpg not downloaded yet
2026-03-24 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473b50>
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/1.jpg saved to cache
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/2.jpg not downloaded yet
2026-03-24 22:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/3.jpg not downloaded yet
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009443090>
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/2.jpg saved to cache
2026-03-24 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b70d0>
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/5.jpg saved to cache
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009686c90>
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/4.jpg saved to cache
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422fd0>
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/3.jpg saved to cache
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091109d0>
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/6.jpg saved to cache
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/4.jpg not downloaded yet
2026-03-24 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/5.jpg not downloaded yet
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963b590>
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/7.jpg saved to cache
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/6.jpg not downloaded yet
2026-03-24 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/7.jpg not downloaded yet
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838a50>
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/8.jpg saved to cache
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/8.jpg not downloaded yet
2026-03-24 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/9.jpg not downloaded yet
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3ad0>
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/9.jpg saved to cache
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ab490>
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fb7fa80a2bfd940cfbee54f35b7455baf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/10.jpg saved to cache
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e
2026-03-24 22:52:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5d7ca9d-9d34-50ce-9519-5cb713e3392e, skipping ID generation
2026-03-24 22:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e with scrape type 1
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e sending to next pipeline
2026-03-24 22:52:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b5d7ca9d-9d34-50ce-9519-5cb713e3392e, identifier: 1980376
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfcad0>
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/1.jpg saved to cache
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/10.jpg not downloaded yet
2026-03-24 22:52:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1980376
2026-03-24 22:52:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1980376
2026-03-24 22:52:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1980376 to the API
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:52:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b5d7ca9d-9d34-50ce-9519-5cb713e3392e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 81688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5d7ca9d-9d34-50ce-9519-5cb713e3392e/b5d7ca9d-9d34-50ce-9519-5cb713e3392e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/b7fa80a2bfd940cfbee54f35b7455baf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980376%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [ayvens.be] INFO: Saving data for 1980376: {'created_time': 1774392778.248721, 'last_price_update_time': 1774392778.248732, 'auction_closing_time': 1774530000.0}
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980376') HTTP/1.1" 204 0
2026-03-24 22:52:58 [ayvens.be] INFO: Found listing with ID: 1980378
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980378%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [ayvens.be] INFO: Scrape type for 1980378: 1
2026-03-24 22:52:58 [ayvens.be] INFO: Extracting data for car ID: 1980378
2026-03-24 22:52:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1980378
2026-03-24 22:52:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 575acd25-7abc-59a1-b3eb-26695f75fd69 with scrape type 1
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/1.jpg not downloaded yet
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b27c550>
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/2.jpg saved to cache
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008312090>
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/4.jpg saved to cache
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1baa10>
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/3.jpg saved to cache
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/2.jpg not downloaded yet
2026-03-24 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/3.jpg not downloaded yet
2026-03-24 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/4.jpg not downloaded yet
2026-03-24 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/5.jpg not downloaded yet
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/6.jpg not downloaded yet
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/7.jpg not downloaded yet
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/8.jpg not downloaded yet
2026-03-24 22:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a9810>
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/6.jpg saved to cache
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/9.jpg not downloaded yet
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a9890>
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/5.jpg saved to cache
2026-03-24 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94a50>
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/7.jpg saved to cache
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/10.jpg not downloaded yet
2026-03-24 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1baad0>
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/8.jpg saved to cache
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb2690>
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/9.jpg saved to cache
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:59 [ayvens.be] INFO: Found listing with ID: 1980379
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980379%27 HTTP/1.1" 200 None
2026-03-24 22:52:59 [ayvens.be] INFO: Scrape type for 1980379: 1
2026-03-24 22:52:59 [ayvens.be] INFO: Extracting data for car ID: 1980379
2026-03-24 22:52:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e09f8733-d950-5fcf-b34d-5f549d9c39ef with identifier: 1980379
2026-03-24 22:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e09f8733-d950-5fcf-b34d-5f549d9c39ef with scrape type 1
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/1.jpg not downloaded yet
2026-03-24 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334250>
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/1.jpg saved to cache
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/2.jpg not downloaded yet
2026-03-24 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009684d10>
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/2.jpg saved to cache
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009113750>
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/3.jpg saved to cache
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a1d10>
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/4.jpg saved to cache
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/3.jpg not downloaded yet
2026-03-24 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/4.jpg not downloaded yet
2026-03-24 22:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110850>
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252F26f9f0b044724f278b271b5db8750dac%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/10.jpg saved to cache
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43
2026-03-24 22:52:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 359087fe-dc4a-5306-b0a4-fb864fbb6f43, skipping ID generation
2026-03-24 22:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with scrape type 1
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43 sending to next pipeline
2026-03-24 22:52:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 359087fe-dc4a-5306-b0a4-fb864fbb6f43, identifier: 1980377
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f0110>
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/5.jpg saved to cache
2026-03-24 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008311d10>
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:52:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:52:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/6.jpg saved to cache
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bc710>
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/7.jpg saved to cache
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/5.jpg not downloaded yet
2026-03-24 22:53:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with identifier: 1980377
2026-03-24 22:53:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with identifier: 1980377
2026-03-24 22:53:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with identifier: 1980377 to the API
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '359087fe-dc4a-5306-b0a4-fb864fbb6f43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'Mini',
 'odometer': 57023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_359087fe-dc4a-5306-b0a4-fb864fbb6f43/359087fe-dc4a-5306-b0a4-fb864fbb6f43_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/26f9f0b044724f278b271b5db8750dac/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Mini 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980377%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [ayvens.be] INFO: Saving data for 1980377: {'created_time': 1774392780.428313, 'last_price_update_time': 1774392780.428322, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980377') HTTP/1.1" 204 0
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/6.jpg not downloaded yet
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643650>
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/8.jpg saved to cache
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964d7d0>
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/9.jpg saved to cache
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/7.jpg not downloaded yet
2026-03-24 22:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/8.jpg not downloaded yet
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/9.jpg not downloaded yet
2026-03-24 22:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/10.jpg not downloaded yet
2026-03-24 22:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:00 [ayvens.be] INFO: Found listing with ID: 1980380
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980380%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [ayvens.be] INFO: Scrape type for 1980380: 1
2026-03-24 22:53:00 [ayvens.be] INFO: Extracting data for car ID: 1980380
2026-03-24 22:53:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f48db72-1693-5c56-a9af-46403435bd2f with identifier: 1980380
2026-03-24 22:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f48db72-1693-5c56-a9af-46403435bd2f with scrape type 1
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/1.jpg not downloaded yet
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/2.jpg not downloaded yet
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009176850>
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fb6db484f1a7b4a689f112ad9a6e7b683%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/10.jpg saved to cache
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 575acd25-7abc-59a1-b3eb-26695f75fd69
2026-03-24 22:53:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 575acd25-7abc-59a1-b3eb-26695f75fd69, skipping ID generation
2026-03-24 22:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 575acd25-7abc-59a1-b3eb-26695f75fd69 with scrape type 1
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 575acd25-7abc-59a1-b3eb-26695f75fd69 sending to next pipeline
2026-03-24 22:53:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 575acd25-7abc-59a1-b3eb-26695f75fd69, identifier: 1980378
2026-03-24 22:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/3.jpg not downloaded yet
2026-03-24 22:53:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1980378
2026-03-24 22:53:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1980378
2026-03-24 22:53:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1980378 to the API
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '575acd25-7abc-59a1-b3eb-26695f75fd69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 51428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_575acd25-7abc-59a1-b3eb-26695f75fd69/575acd25-7abc-59a1-b3eb-26695f75fd69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/b6db484f1a7b4a689f112ad9a6e7b683/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980378%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [ayvens.be] INFO: Saving data for 1980378: {'created_time': 1774392781.272675, 'last_price_update_time': 1774392781.272684, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980378') HTTP/1.1" 204 0
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/4.jpg not downloaded yet
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b4a10>
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/1.jpg saved to cache
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008370b90>
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/2.jpg saved to cache
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed20d0>
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/3.jpg saved to cache
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083368d0>
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/4.jpg saved to cache
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/5.jpg not downloaded yet
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/6.jpg not downloaded yet
2026-03-24 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/7.jpg not downloaded yet
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/8.jpg not downloaded yet
2026-03-24 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/9.jpg not downloaded yet
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/10.jpg not downloaded yet
2026-03-24 22:53:01 [ayvens.be] INFO: Found listing with ID: 1980381
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980381%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [ayvens.be] INFO: Scrape type for 1980381: 1
2026-03-24 22:53:01 [ayvens.be] INFO: Extracting data for car ID: 1980381
2026-03-24 22:53:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1980381
2026-03-24 22:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f19dff6-09d0-5024-b64c-2157ab8048d4 with scrape type 1
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/1.jpg not downloaded yet
2026-03-24 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/2.jpg not downloaded yet
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091862d0>
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/6.jpg saved to cache
2026-03-24 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871010>
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/5.jpg saved to cache
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bcd10>
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/8.jpg saved to cache
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009123750>
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/7.jpg saved to cache
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/3.jpg not downloaded yet
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963a490>
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/9.jpg saved to cache
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc5dd0>
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F36b4f9f20b114554bf50dc1073c13077%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/10.jpg saved to cache
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e09f8733-d950-5fcf-b34d-5f549d9c39ef
2026-03-24 22:53:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e09f8733-d950-5fcf-b34d-5f549d9c39ef, skipping ID generation
2026-03-24 22:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e09f8733-d950-5fcf-b34d-5f549d9c39ef with scrape type 1
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e09f8733-d950-5fcf-b34d-5f549d9c39ef sending to next pipeline
2026-03-24 22:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e09f8733-d950-5fcf-b34d-5f549d9c39ef, identifier: 1980379
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/4.jpg not downloaded yet
2026-03-24 22:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e09f8733-d950-5fcf-b34d-5f549d9c39ef with identifier: 1980379
2026-03-24 22:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e09f8733-d950-5fcf-b34d-5f549d9c39ef with identifier: 1980379
2026-03-24 22:53:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e09f8733-d950-5fcf-b34d-5f549d9c39ef with identifier: 1980379 to the API
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'e09f8733-d950-5fcf-b34d-5f549d9c39ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 59196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e09f8733-d950-5fcf-b34d-5f549d9c39ef/e09f8733-d950-5fcf-b34d-5f549d9c39ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/36b4f9f20b114554bf50dc1073c13077/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 BEV 82KWH 128KW PRO BUSINESS',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 128KW PRO BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980379%27 HTTP/1.1" 200 None
2026-03-24 22:53:02 [ayvens.be] INFO: Saving data for 1980379: {'created_time': 1774392782.996347, 'last_price_update_time': 1774392782.996357, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980379') HTTP/1.1" 204 0
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405090>
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/1.jpg saved to cache
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008324750>
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/2.jpg saved to cache
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/5.jpg not downloaded yet
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/6.jpg not downloaded yet
2026-03-24 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/7.jpg not downloaded yet
2026-03-24 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/8.jpg not downloaded yet
2026-03-24 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/9.jpg not downloaded yet
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/10.jpg not downloaded yet
2026-03-24 22:53:03 [ayvens.be] INFO: Found listing with ID: 1980382
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980382%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [ayvens.be] INFO: Scrape type for 1980382: 1
2026-03-24 22:53:03 [ayvens.be] INFO: Extracting data for car ID: 1980382
2026-03-24 22:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1980382
2026-03-24 22:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with scrape type 1
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/1.jpg not downloaded yet
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/2.jpg not downloaded yet
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bfa10>
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/7.jpg saved to cache
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009617310>
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/3.jpg saved to cache
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/3.jpg not downloaded yet
2026-03-24 22:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a0710>
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/6.jpg saved to cache
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964ca90>
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/4.jpg saved to cache
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096dfe90>
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/5.jpg saved to cache
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472d10>
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/8.jpg saved to cache
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/4.jpg not downloaded yet
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4350>
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/9.jpg saved to cache
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/5.jpg not downloaded yet
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b98d0>
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/3.jpg saved to cache
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/6.jpg not downloaded yet
2026-03-24 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/7.jpg not downloaded yet
2026-03-24 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112050>
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/2.jpg saved to cache
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/8.jpg not downloaded yet
2026-03-24 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/9.jpg not downloaded yet
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/10.jpg not downloaded yet
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097625d0>
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/4.jpg saved to cache
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec7650>
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/1.jpg saved to cache
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a29390>
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/5.jpg saved to cache
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:04 [ayvens.be] INFO: Found listing with ID: 1980383
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980383%27 HTTP/1.1" 200 None
2026-03-24 22:53:04 [ayvens.be] INFO: Scrape type for 1980383: 1
2026-03-24 22:53:04 [ayvens.be] INFO: Extracting data for car ID: 1980383
2026-03-24 22:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1980383
2026-03-24 22:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with scrape type 1
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/1.jpg not downloaded yet
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009491450>
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fa2b695d24f9443749c664917b7ab3626%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/10.jpg saved to cache
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f48db72-1693-5c56-a9af-46403435bd2f
2026-03-24 22:53:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f48db72-1693-5c56-a9af-46403435bd2f, skipping ID generation
2026-03-24 22:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f48db72-1693-5c56-a9af-46403435bd2f with scrape type 1
2026-03-24 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f48db72-1693-5c56-a9af-46403435bd2f sending to next pipeline
2026-03-24 22:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2f48db72-1693-5c56-a9af-46403435bd2f, identifier: 1980380
2026-03-24 22:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2f48db72-1693-5c56-a9af-46403435bd2f with identifier: 1980380
2026-03-24 22:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2f48db72-1693-5c56-a9af-46403435bd2f with identifier: 1980380
2026-03-24 22:53:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2f48db72-1693-5c56-a9af-46403435bd2f with identifier: 1980380 to the API
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '2f48db72-1693-5c56-a9af-46403435bd2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MAu2030GANE BERLINE',
 'odometer': 119557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 827830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f48db72-1693-5c56-a9af-46403435bd2f/2f48db72-1693-5c56-a9af-46403435bd2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/a2b695d24f9443749c664917b7ab3626/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MAu2030GANE BERLINE 1.5 BLUE DCI 115 CORPORATE EDITION',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 115 CORPORATE EDITION',
 'vin': None,
 'year': 2021}
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980380%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [ayvens.be] INFO: Saving data for 1980380: {'created_time': 1774392785.236388, 'last_price_update_time': 1774392785.236397, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980380') HTTP/1.1" 204 0
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/2.jpg not downloaded yet
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2b10>
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/6.jpg saved to cache
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666bd0>
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/7.jpg saved to cache
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/3.jpg not downloaded yet
2026-03-24 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/4.jpg not downloaded yet
2026-03-24 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/5.jpg not downloaded yet
2026-03-24 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/6.jpg not downloaded yet
2026-03-24 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/7.jpg not downloaded yet
2026-03-24 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/8.jpg not downloaded yet
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec5990>
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/3.jpg saved to cache
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/9.jpg not downloaded yet
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec4950>
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/10.jpg saved to cache
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/10.jpg not downloaded yet
2026-03-24 22:53:05 [ayvens.be] INFO: Found listing with ID: 1980384
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980384%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [ayvens.be] INFO: Scrape type for 1980384: 1
2026-03-24 22:53:05 [ayvens.be] INFO: Extracting data for car ID: 1980384
2026-03-24 22:53:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1980384
2026-03-24 22:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b09540-2cfa-59a3-bcbe-719968d86e7f with scrape type 1
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/1.jpg not downloaded yet
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b58ae50>
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/2.jpg saved to cache
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964ccd0>
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/5.jpg saved to cache
2026-03-24 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449650>
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/1.jpg saved to cache
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492fd0>
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/4.jpg saved to cache
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b850>
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/9.jpg saved to cache
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3b10>
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8fc2f1852958465e8c909e5804f12dba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/8.jpg saved to cache
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f19dff6-09d0-5024-b64c-2157ab8048d4
2026-03-24 22:53:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f19dff6-09d0-5024-b64c-2157ab8048d4, skipping ID generation
2026-03-24 22:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f19dff6-09d0-5024-b64c-2157ab8048d4 with scrape type 1
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f19dff6-09d0-5024-b64c-2157ab8048d4 sending to next pipeline
2026-03-24 22:53:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7f19dff6-09d0-5024-b64c-2157ab8048d4, identifier: 1980381
2026-03-24 22:53:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1980381
2026-03-24 22:53:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1980381
2026-03-24 22:53:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1980381 to the API
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7f19dff6-09d0-5024-b64c-2157ab8048d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 47509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 887547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f19dff6-09d0-5024-b64c-2157ab8048d4/7f19dff6-09d0-5024-b64c-2157ab8048d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8fc2f1852958465e8c909e5804f12dba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 2.0 CLA 180 D BUS SOLUTION '
          'ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980381%27 HTTP/1.1" 200 None
2026-03-24 22:53:06 [ayvens.be] INFO: Saving data for 1980381: {'created_time': 1774392786.769782, 'last_price_update_time': 1774392786.769791, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980381') HTTP/1.1" 204 0
2026-03-24 22:53:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -2 pages/min), scraped 371 items (at 38 items/min)
2026-03-24 22:53:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/2.jpg not downloaded yet
2026-03-24 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/3.jpg not downloaded yet
2026-03-24 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/4.jpg not downloaded yet
2026-03-24 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/5.jpg not downloaded yet
2026-03-24 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/6.jpg not downloaded yet
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/7.jpg not downloaded yet
2026-03-24 22:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/8.jpg not downloaded yet
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441e90>
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/7.jpg saved to cache
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/9.jpg not downloaded yet
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d03fd0>
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/6.jpg saved to cache
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/10.jpg not downloaded yet
2026-03-24 22:53:07 [ayvens.be] INFO: Found listing with ID: 1980385
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980385%27 HTTP/1.1" 200 None
2026-03-24 22:53:07 [ayvens.be] INFO: Scrape type for 1980385: 1
2026-03-24 22:53:07 [ayvens.be] INFO: Extracting data for car ID: 1980385
2026-03-24 22:53:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1980385
2026-03-24 22:53:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c16ce4-23e7-5da6-9da3-86696de860c7 with scrape type 1
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/1.jpg not downloaded yet
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b150>
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/1.jpg saved to cache
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983bcd0>
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/2.jpg saved to cache
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009686050>
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/8.jpg saved to cache
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008325450>
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/3.jpg saved to cache
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009684a50>
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/9.jpg saved to cache
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914cc90>
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F7c3e16c49ad84bb7929dfab64b8a2a18%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/10.jpg saved to cache
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380
2026-03-24 22:53:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380, skipping ID generation
2026-03-24 22:53:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with scrape type 1
2026-03-24 22:53:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 sending to next pipeline
2026-03-24 22:53:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380, identifier: 1980382
2026-03-24 22:53:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1980382
2026-03-24 22:53:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1980382
2026-03-24 22:53:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1980382 to the API
2026-03-24 22:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e2e328d8-b8fa-5e9a-aacc-ce7d1babb380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5Aircross',
 'odometer': 93476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 913728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e328d8-b8fa-5e9a-aacc-ce7d1babb380/e2e328d8-b8fa-5e9a-aacc-ce7d1babb380_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/7c3e16c49ad84bb7929dfab64b8a2a18/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5Aircross 1.6 PHEV 225 E-EAT8 BUS. LOUNGE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-EAT8 BUS. LOUNGE AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980382%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [ayvens.be] INFO: Saving data for 1980382: {'created_time': 1774392788.17621, 'last_price_update_time': 1774392788.176219, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980382') HTTP/1.1" 204 0
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/2.jpg not downloaded yet
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/3.jpg not downloaded yet
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/4.jpg not downloaded yet
2026-03-24 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/5.jpg not downloaded yet
2026-03-24 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/6.jpg not downloaded yet
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/7.jpg not downloaded yet
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/8.jpg not downloaded yet
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/9.jpg not downloaded yet
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/10.jpg not downloaded yet
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639450>
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/8.jpg saved to cache
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008380290>
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/9.jpg saved to cache
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009665e10>
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/7.jpg saved to cache
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:08 [ayvens.be] INFO: Found listing with ID: 1980386
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980386%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [ayvens.be] INFO: Scrape type for 1980386: 1
2026-03-24 22:53:08 [ayvens.be] INFO: Extracting data for car ID: 1980386
2026-03-24 22:53:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1980386
2026-03-24 22:53:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32502b7-c4ac-5350-8b50-67b8224804a5 with scrape type 1
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/1.jpg not downloaded yet
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009009090>
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/5.jpg saved to cache
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638450>
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/1.jpg saved to cache
2026-03-24 22:53:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145390>
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/4.jpg saved to cache
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666050>
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/10.jpg saved to cache
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464810>
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F1d2d04b0f95443938e807cc5748d00d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/6.jpg saved to cache
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d
2026-03-24 22:53:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d, skipping ID generation
2026-03-24 22:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with scrape type 1
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d sending to next pipeline
2026-03-24 22:53:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d, identifier: 1980383
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/2.jpg not downloaded yet
2026-03-24 22:53:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1980383
2026-03-24 22:53:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1980383
2026-03-24 22:53:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1980383 to the API
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 88931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 838782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 821901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 873656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d/2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/1d2d04b0f95443938e807cc5748d00d4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS LINE',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS LINE',
 'vin': None,
 'year': 2023}
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980383%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [ayvens.be] INFO: Saving data for 1980383: {'created_time': 1774392789.7293, 'last_price_update_time': 1774392789.729314, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980383') HTTP/1.1" 204 0
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/3.jpg not downloaded yet
2026-03-24 22:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/4.jpg not downloaded yet
2026-03-24 22:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/5.jpg not downloaded yet
2026-03-24 22:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/6.jpg not downloaded yet
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/7.jpg not downloaded yet
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/8.jpg not downloaded yet
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/9.jpg not downloaded yet
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/10.jpg not downloaded yet
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009870f50>
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/2.jpg saved to cache
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:10 [ayvens.be] INFO: Found listing with ID: 1980387
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980387%27 HTTP/1.1" 200 None
2026-03-24 22:53:10 [ayvens.be] INFO: Scrape type for 1980387: 1
2026-03-24 22:53:10 [ayvens.be] INFO: Extracting data for car ID: 1980387
2026-03-24 22:53:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1980387
2026-03-24 22:53:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7ee486-8742-5e66-b3be-58363099d735 with scrape type 1
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/1.jpg not downloaded yet
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872190>
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/3.jpg saved to cache
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b9350>
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/4.jpg saved to cache
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008313c50>
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/10.jpg saved to cache
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bbc90>
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/1.jpg saved to cache
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cfc50>
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/2.jpg saved to cache
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/2.jpg not downloaded yet
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/3.jpg not downloaded yet
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008384190>
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/8.jpg saved to cache
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839b550>
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/9.jpg saved to cache
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/4.jpg not downloaded yet
2026-03-24 22:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/5.jpg not downloaded yet
2026-03-24 22:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ba5d0>
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/1.jpg saved to cache
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/6.jpg not downloaded yet
2026-03-24 22:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/7.jpg not downloaded yet
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/8.jpg not downloaded yet
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083858d0>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/7.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838510>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/3.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009421e90>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/6.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009465410>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/7.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/9.jpg not downloaded yet
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/10.jpg not downloaded yet
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfe450>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/3.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008337a90>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/8.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830bfd0>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/9.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c1ed0>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/10.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [ayvens.be] INFO: Found listing with ID: 1980388
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980388%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [ayvens.be] INFO: Scrape type for 1980388: 1
2026-03-24 22:53:11 [ayvens.be] INFO: Extracting data for car ID: 1980388
2026-03-24 22:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1980388
2026-03-24 22:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3059e2-656c-5e69-aca5-e764afd132b2 with scrape type 1
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/1.jpg not downloaded yet
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/2.jpg not downloaded yet
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/3.jpg not downloaded yet
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407150>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/4.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/4.jpg not downloaded yet
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/5.jpg not downloaded yet
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407b50>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/2.jpg saved to cache
2026-03-24 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009758150>
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/2.jpg saved to cache
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a29010>
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/1.jpg saved to cache
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1bb350>
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/10.jpg saved to cache
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/6.jpg not downloaded yet
2026-03-24 22:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2a750>
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/3.jpg saved to cache
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/7.jpg not downloaded yet
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/8.jpg not downloaded yet
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008326110>
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/6.jpg saved to cache
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1bb6d0>
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/4.jpg saved to cache
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8250>
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ef%252Ff6d5528eabf24e19aa1800933a8c20fc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/5.jpg saved to cache
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99c16ce4-23e7-5da6-9da3-86696de860c7
2026-03-24 22:53:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99c16ce4-23e7-5da6-9da3-86696de860c7, skipping ID generation
2026-03-24 22:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c16ce4-23e7-5da6-9da3-86696de860c7 with scrape type 1
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99c16ce4-23e7-5da6-9da3-86696de860c7 sending to next pipeline
2026-03-24 22:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99c16ce4-23e7-5da6-9da3-86696de860c7, identifier: 1980385
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a4d10>
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/9.jpg saved to cache
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009467250>
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/4.jpg saved to cache
2026-03-24 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1980385
2026-03-24 22:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1980385
2026-03-24 22:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1980385 to the API
2026-03-24 22:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '99c16ce4-23e7-5da6-9da3-86696de860c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 20854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 885943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c16ce4-23e7-5da6-9da3-86696de860c7/99c16ce4-23e7-5da6-9da3-86696de860c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ef/f6d5528eabf24e19aa1800933a8c20fc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980385%27 HTTP/1.1" 200 None
2026-03-24 22:53:15 [ayvens.be] INFO: Saving data for 1980385: {'created_time': 1774392795.21744, 'last_price_update_time': 1774392795.217453, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980385') HTTP/1.1" 204 0
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/9.jpg not downloaded yet
2026-03-24 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/10.jpg not downloaded yet
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098392d0>
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/5.jpg saved to cache
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00964c810>
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/8.jpg saved to cache
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093bae10>
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/7.jpg saved to cache
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28090>
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/8.jpg saved to cache
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978be10>
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/7.jpg saved to cache
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009147550>
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/6.jpg saved to cache
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:15 [ayvens.be] INFO: Found listing with ID: 1980389
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980389%27 HTTP/1.1" 200 None
2026-03-24 22:53:15 [ayvens.be] INFO: Scrape type for 1980389: 1
2026-03-24 22:53:15 [ayvens.be] INFO: Extracting data for car ID: 1980389
2026-03-24 22:53:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e61c9470-165e-5a83-aef1-7e0b32965a70 with identifier: 1980389
2026-03-24 22:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e61c9470-165e-5a83-aef1-7e0b32965a70 with scrape type 1
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/1.jpg not downloaded yet
2026-03-24 22:53:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/2.jpg not downloaded yet
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009718b10>
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/9.jpg saved to cache
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e3e10>
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3727d44e4ceb46cf96716afab1d3a63b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/10.jpg saved to cache
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f7ee486-8742-5e66-b3be-58363099d735
2026-03-24 22:53:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f7ee486-8742-5e66-b3be-58363099d735, skipping ID generation
2026-03-24 22:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7ee486-8742-5e66-b3be-58363099d735 with scrape type 1
2026-03-24 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f7ee486-8742-5e66-b3be-58363099d735 sending to next pipeline
2026-03-24 22:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1f7ee486-8742-5e66-b3be-58363099d735, identifier: 1980387
2026-03-24 22:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1980387
2026-03-24 22:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1980387
2026-03-24 22:53:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1980387 to the API
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1f7ee486-8742-5e66-b3be-58363099d735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 114773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f7ee486-8742-5e66-b3be-58363099d735/1f7ee486-8742-5e66-b3be-58363099d735_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3727d44e4ceb46cf96716afab1d3a63b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T5 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980387%27 HTTP/1.1" 200 None
2026-03-24 22:53:16 [ayvens.be] INFO: Saving data for 1980387: {'created_time': 1774392796.418993, 'last_price_update_time': 1774392796.419002, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980387') HTTP/1.1" 204 0
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/3.jpg not downloaded yet
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/4.jpg not downloaded yet
2026-03-24 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009010690>
2026-03-24 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/6.jpg saved to cache
2026-03-24 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d910>
2026-03-24 22:53:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F55c65efcf35340aeb9a43a1cd1456467%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/5.jpg saved to cache
2026-03-24 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f32502b7-c4ac-5350-8b50-67b8224804a5
2026-03-24 22:53:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f32502b7-c4ac-5350-8b50-67b8224804a5, skipping ID generation
2026-03-24 22:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32502b7-c4ac-5350-8b50-67b8224804a5 with scrape type 1
2026-03-24 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f32502b7-c4ac-5350-8b50-67b8224804a5 sending to next pipeline
2026-03-24 22:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f32502b7-c4ac-5350-8b50-67b8224804a5, identifier: 1980386
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/5.jpg not downloaded yet
2026-03-24 22:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1980386
2026-03-24 22:53:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1980386
2026-03-24 22:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1980386 to the API
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'PHYTONICBLAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f32502b7-c4ac-5350-8b50-67b8224804a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 175679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32502b7-c4ac-5350-8b50-67b8224804a5/f32502b7-c4ac-5350-8b50-67b8224804a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/55c65efcf35340aeb9a43a1cd1456467/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 SDRIVE18D (110KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18D (110KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980386%27 HTTP/1.1" 200 None
2026-03-24 22:53:17 [ayvens.be] INFO: Saving data for 1980386: {'created_time': 1774392797.340656, 'last_price_update_time': 1774392797.340666, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980386') HTTP/1.1" 204 0
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/6.jpg not downloaded yet
2026-03-24 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/7.jpg not downloaded yet
2026-03-24 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/8.jpg not downloaded yet
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/9.jpg not downloaded yet
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/10.jpg not downloaded yet
2026-03-24 22:53:17 [ayvens.be] INFO: Found listing with ID: 1980390
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980390%27 HTTP/1.1" 200 None
2026-03-24 22:53:17 [ayvens.be] INFO: Scrape type for 1980390: 1
2026-03-24 22:53:17 [ayvens.be] INFO: Extracting data for car ID: 1980390
2026-03-24 22:53:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1980390
2026-03-24 22:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973b0b30-ae16-5993-8445-749a81894b5c with scrape type 1
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/1.jpg not downloaded yet
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/2.jpg not downloaded yet
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc5250>
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/1.jpg saved to cache
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119cd0>
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fm%252F107a7de6759f482ba34b4a449637d0c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/5.jpg saved to cache
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44b09540-2cfa-59a3-bcbe-719968d86e7f
2026-03-24 22:53:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44b09540-2cfa-59a3-bcbe-719968d86e7f, skipping ID generation
2026-03-24 22:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b09540-2cfa-59a3-bcbe-719968d86e7f with scrape type 1
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44b09540-2cfa-59a3-bcbe-719968d86e7f sending to next pipeline
2026-03-24 22:53:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 44b09540-2cfa-59a3-bcbe-719968d86e7f, identifier: 1980384
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083728d0>
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/2.jpg saved to cache
2026-03-24 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871510>
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/5.jpg saved to cache
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009940490>
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/4.jpg saved to cache
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911a9d0>
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/3.jpg saved to cache
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/3.jpg not downloaded yet
2026-03-24 22:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1980384
2026-03-24 22:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1980384
2026-03-24 22:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1980384 to the API
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '44b09540-2cfa-59a3-bcbe-719968d86e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 SPORTBACK E-TRON',
 'odometer': 13316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b09540-2cfa-59a3-bcbe-719968d86e7f/44b09540-2cfa-59a3-bcbe-719968d86e7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fm/107a7de6759f482ba34b4a449637d0c6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 SPORTBACK E-TRON BEV 82KWH 40 ADVANCED AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ADVANCED AUTO',
 'vin': None,
 'year': 2024}
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980384%27 HTTP/1.1" 200 None
2026-03-24 22:53:18 [ayvens.be] INFO: Saving data for 1980384: {'created_time': 1774392798.611749, 'last_price_update_time': 1774392798.611758, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980384') HTTP/1.1" 204 0
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1090>
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/7.jpg saved to cache
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009404d50>
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/6.jpg saved to cache
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/4.jpg not downloaded yet
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/5.jpg not downloaded yet
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/6.jpg not downloaded yet
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/7.jpg not downloaded yet
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/8.jpg not downloaded yet
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/9.jpg not downloaded yet
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/10.jpg not downloaded yet
2026-03-24 22:53:19 [ayvens.be] INFO: Found listing with ID: 1980391
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980391%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [ayvens.be] INFO: Scrape type for 1980391: 1
2026-03-24 22:53:19 [ayvens.be] INFO: Extracting data for car ID: 1980391
2026-03-24 22:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1980391
2026-03-24 22:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with scrape type 1
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/1.jpg not downloaded yet
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/2.jpg not downloaded yet
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/3.jpg not downloaded yet
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/4.jpg not downloaded yet
2026-03-24 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/5.jpg not downloaded yet
2026-03-24 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/6.jpg not downloaded yet
2026-03-24 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/7.jpg not downloaded yet
2026-03-24 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/8.jpg not downloaded yet
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/9.jpg not downloaded yet
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/10.jpg not downloaded yet
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394850>
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/5.jpg saved to cache
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:19 [ayvens.be] INFO: Found listing with ID: 1980392
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980392%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [ayvens.be] INFO: Scrape type for 1980392: 1
2026-03-24 22:53:19 [ayvens.be] INFO: Extracting data for car ID: 1980392
2026-03-24 22:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1980392
2026-03-24 22:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with scrape type 1
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/1.jpg not downloaded yet
2026-03-24 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008384a90>
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/2.jpg saved to cache
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/2.jpg not downloaded yet
2026-03-24 22:53:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/3.jpg not downloaded yet
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009612810>
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/8.jpg saved to cache
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788d90>
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/4.jpg saved to cache
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406090>
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/10.jpg saved to cache
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ee750>
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F85db677b14a14f06bbef5848d789a26f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/9.jpg saved to cache
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be3059e2-656c-5e69-aca5-e764afd132b2
2026-03-24 22:53:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be3059e2-656c-5e69-aca5-e764afd132b2, skipping ID generation
2026-03-24 22:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3059e2-656c-5e69-aca5-e764afd132b2 with scrape type 1
2026-03-24 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be3059e2-656c-5e69-aca5-e764afd132b2 sending to next pipeline
2026-03-24 22:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: be3059e2-656c-5e69-aca5-e764afd132b2, identifier: 1980388
2026-03-24 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1980388
2026-03-24 22:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1980388
2026-03-24 22:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1980388 to the API
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'be3059e2-656c-5e69-aca5-e764afd132b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 124353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 919662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be3059e2-656c-5e69-aca5-e764afd132b2/be3059e2-656c-5e69-aca5-e764afd132b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 919662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/85db677b14a14f06bbef5848d789a26f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980388%27 HTTP/1.1" 200 None
2026-03-24 22:53:20 [ayvens.be] INFO: Saving data for 1980388: {'created_time': 1774392800.435845, 'last_price_update_time': 1774392800.435854, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980388') HTTP/1.1" 204 0
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/4.jpg not downloaded yet
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a2450>
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/3.jpg saved to cache
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/5.jpg not downloaded yet
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473a90>
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/1.jpg saved to cache
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018990>
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/6.jpg saved to cache
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a2110>
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/3.jpg saved to cache
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/6.jpg not downloaded yet
2026-03-24 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/7.jpg not downloaded yet
2026-03-24 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/8.jpg not downloaded yet
2026-03-24 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/9.jpg not downloaded yet
2026-03-24 22:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/10.jpg not downloaded yet
2026-03-24 22:53:20 [ayvens.be] INFO: Found listing with ID: 1980393
2026-03-24 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980393%27 HTTP/1.1" 200 None
2026-03-24 22:53:21 [ayvens.be] INFO: Scrape type for 1980393: 1
2026-03-24 22:53:21 [ayvens.be] INFO: Extracting data for car ID: 1980393
2026-03-24 22:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1980393
2026-03-24 22:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with scrape type 1
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/1.jpg not downloaded yet
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/2.jpg not downloaded yet
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345350>
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/2.jpg saved to cache
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/3.jpg not downloaded yet
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0810>
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/10.jpg saved to cache
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838c9d0>
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/9.jpg saved to cache
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/4.jpg not downloaded yet
2026-03-24 22:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970cf90>
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/4.jpg saved to cache
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c0090>
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/1.jpg saved to cache
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128c90>
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/7.jpg saved to cache
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb150>
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/3.jpg saved to cache
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912ad10>
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F72a48057e0ce46069aef73bf7177de6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/8.jpg saved to cache
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e61c9470-165e-5a83-aef1-7e0b32965a70
2026-03-24 22:53:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e61c9470-165e-5a83-aef1-7e0b32965a70, skipping ID generation
2026-03-24 22:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e61c9470-165e-5a83-aef1-7e0b32965a70 with scrape type 1
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e61c9470-165e-5a83-aef1-7e0b32965a70 sending to next pipeline
2026-03-24 22:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e61c9470-165e-5a83-aef1-7e0b32965a70, identifier: 1980389
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c7b10>
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/6.jpg saved to cache
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/5.jpg not downloaded yet
2026-03-24 22:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e61c9470-165e-5a83-aef1-7e0b32965a70 with identifier: 1980389
2026-03-24 22:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e61c9470-165e-5a83-aef1-7e0b32965a70 with identifier: 1980389
2026-03-24 22:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e61c9470-165e-5a83-aef1-7e0b32965a70 with identifier: 1980389 to the API
2026-03-24 22:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e61c9470-165e-5a83-aef1-7e0b32965a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MAZDA',
 'model': 'CX-5 DIESEL - 2017',
 'odometer': 113138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e61c9470-165e-5a83-aef1-7e0b32965a70/e61c9470-165e-5a83-aef1-7e0b32965a70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/72a48057e0ce46069aef73bf7177de6e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MAZDA CX-5 DIESEL - 2017 2.2 SKY-D 4WD Skycruise Takumi (EU6d-T)',
 'transmission': 'manual',
 'trim': '2.2 SKY-D 4WD Skycruise Takumi (EU6d-T)',
 'vin': None,
 'year': 2021}
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980389%27 HTTP/1.1" 200 None
2026-03-24 22:53:23 [ayvens.be] INFO: Saving data for 1980389: {'created_time': 1774392803.173319, 'last_price_update_time': 1774392803.173328, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980389') HTTP/1.1" 204 0
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/6.jpg not downloaded yet
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915eb90>
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/5.jpg saved to cache
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008324390>
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/2.jpg saved to cache
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c6b10>
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/7.jpg saved to cache
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/7.jpg not downloaded yet
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/8.jpg not downloaded yet
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008381610>
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/1.jpg saved to cache
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959e390>
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/10.jpg saved to cache
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/9.jpg not downloaded yet
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/10.jpg not downloaded yet
2026-03-24 22:53:23 [ayvens.be] INFO: Found listing with ID: 1980394
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980394%27 HTTP/1.1" 200 None
2026-03-24 22:53:23 [ayvens.be] INFO: Scrape type for 1980394: 1
2026-03-24 22:53:23 [ayvens.be] INFO: Extracting data for car ID: 1980394
2026-03-24 22:53:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1980394
2026-03-24 22:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df095015-0ccb-5f99-b189-ce5e41de1ee3 with scrape type 1
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/1.jpg not downloaded yet
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971a350>
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/3.jpg saved to cache
2026-03-24 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f86d0>
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/2.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945fcd0>
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/5.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cbbd0>
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/6.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009862490>
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/7.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945f2d0>
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/9.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/2.jpg not downloaded yet
2026-03-24 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/3.jpg not downloaded yet
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946fe50>
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/8.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978bd90>
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/4.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/4.jpg not downloaded yet
2026-03-24 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/5.jpg not downloaded yet
2026-03-24 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/6.jpg not downloaded yet
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3a10>
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/10.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946f890>
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/8.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/7.jpg not downloaded yet
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/8.jpg not downloaded yet
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4d50>
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F1fb59b9cb70f4f6d915e0f8822d4d3e2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/9.jpg saved to cache
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134
2026-03-24 22:53:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86223df2-a655-5ba1-8ef4-a3eea7e1c134, skipping ID generation
2026-03-24 22:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with scrape type 1
2026-03-24 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 sending to next pipeline
2026-03-24 22:53:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86223df2-a655-5ba1-8ef4-a3eea7e1c134, identifier: 1980392
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d2a10>
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/4.jpg saved to cache
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008387a50>
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/1.jpg saved to cache
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0390>
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/3.jpg saved to cache
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9e10>
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/2.jpg saved to cache
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/9.jpg not downloaded yet
2026-03-24 22:53:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1980392
2026-03-24 22:53:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1980392
2026-03-24 22:53:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1980392 to the API
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '86223df2-a655-5ba1-8ef4-a3eea7e1c134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 214066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86223df2-a655-5ba1-8ef4-a3eea7e1c134/86223df2-a655-5ba1-8ef4-a3eea7e1c134_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/1fb59b9cb70f4f6d915e0f8822d4d3e2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV PLUS BRIGHT DESIGN DCT',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV PLUS BRIGHT DESIGN DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980392%27 HTTP/1.1" 200 None
2026-03-24 22:53:25 [ayvens.be] INFO: Saving data for 1980392: {'created_time': 1774392805.90292, 'last_price_update_time': 1774392805.902932, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980392') HTTP/1.1" 204 0
2026-03-24 22:53:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/10.jpg not downloaded yet
2026-03-24 22:53:25 [ayvens.be] INFO: Found listing with ID: 1980395
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980395%27 HTTP/1.1" 200 None
2026-03-24 22:53:25 [ayvens.be] INFO: Scrape type for 1980395: 1
2026-03-24 22:53:25 [ayvens.be] INFO: Extracting data for car ID: 1980395
2026-03-24 22:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1980395
2026-03-24 22:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d with scrape type 1
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/1.jpg not downloaded yet
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a2210>
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/5.jpg saved to cache
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/2.jpg not downloaded yet
2026-03-24 22:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/3.jpg not downloaded yet
2026-03-24 22:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2390>
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/6.jpg saved to cache
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/4.jpg not downloaded yet
2026-03-24 22:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/5.jpg not downloaded yet
2026-03-24 22:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/6.jpg not downloaded yet
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641690>
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/7.jpg saved to cache
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914e010>
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4c84ab3e9ba74c0982b15cfbb178c735%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/1.jpg saved to cache
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc
2026-03-24 22:53:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc, skipping ID generation
2026-03-24 22:53:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with scrape type 1
2026-03-24 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc sending to next pipeline
2026-03-24 22:53:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc, identifier: 1980391
2026-03-24 22:53:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1980391
2026-03-24 22:53:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1980391
2026-03-24 22:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1980391 to the API
2026-03-24 22:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '555f67f7-ee2f-5c9f-8fd6-24113fff47fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 80415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f67f7-ee2f-5c9f-8fd6-24113fff47fc/555f67f7-ee2f-5c9f-8fd6-24113fff47fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4c84ab3e9ba74c0982b15cfbb178c735/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980391%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [ayvens.be] INFO: Saving data for 1980391: {'created_time': 1774392807.204635, 'last_price_update_time': 1774392807.204645, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980391') HTTP/1.1" 204 0
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/7.jpg not downloaded yet
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1abdd0>
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/9.jpg saved to cache
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917f950>
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/10.jpg saved to cache
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/8.jpg not downloaded yet
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b62ad0>
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/8.jpg saved to cache
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d00d90>
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/8.jpg saved to cache
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009448910>
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/9.jpg saved to cache
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/9.jpg not downloaded yet
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/10.jpg not downloaded yet
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094931d0>
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/1.jpg saved to cache
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:27 [ayvens.be] INFO: Found listing with ID: 1980396
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980396%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [ayvens.be] INFO: Scrape type for 1980396: 1
2026-03-24 22:53:27 [ayvens.be] INFO: Extracting data for car ID: 1980396
2026-03-24 22:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1980396
2026-03-24 22:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with scrape type 1
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/1.jpg not downloaded yet
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/2.jpg not downloaded yet
2026-03-24 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/3.jpg not downloaded yet
2026-03-24 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/4.jpg not downloaded yet
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/5.jpg not downloaded yet
2026-03-24 22:53:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/6.jpg not downloaded yet
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e950>
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/2.jpg saved to cache
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962cdd0>
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/3.jpg saved to cache
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/7.jpg not downloaded yet
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/8.jpg not downloaded yet
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/9.jpg not downloaded yet
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a25d0>
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/5.jpg saved to cache
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091411d0>
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/4.jpg saved to cache
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb2f90>
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/7.jpg saved to cache
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347c10>
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F521160fab54b4102828410194bf4bc76%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/10.jpg saved to cache
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d
2026-03-24 22:53:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d, skipping ID generation
2026-03-24 22:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with scrape type 1
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d sending to next pipeline
2026-03-24 22:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d, identifier: 1980393
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce510>
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/6.jpg saved to cache
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175bd0>
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/9.jpg saved to cache
2026-03-24 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1980393
2026-03-24 22:53:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1980393
2026-03-24 22:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1980393 to the API
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 87175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 903370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d/4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/521160fab54b4102828410194bf4bc76/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'transmission': 'automatic',
 'trim': '1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'vin': None,
 'year': 2021}
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980393%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [ayvens.be] INFO: Saving data for 1980393: {'created_time': 1774392809.290373, 'last_price_update_time': 1774392809.290382, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980393') HTTP/1.1" 204 0
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/10.jpg not downloaded yet
2026-03-24 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:29 [ayvens.be] INFO: Found listing with ID: 1980397
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980397%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [ayvens.be] INFO: Scrape type for 1980397: 1
2026-03-24 22:53:29 [ayvens.be] INFO: Extracting data for car ID: 1980397
2026-03-24 22:53:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with identifier: 1980397
2026-03-24 22:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with scrape type 1
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/1.jpg not downloaded yet
2026-03-24 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/2.jpg not downloaded yet
2026-03-24 22:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/3.jpg not downloaded yet
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/4.jpg not downloaded yet
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/5.jpg not downloaded yet
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008381450>
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/2.jpg saved to cache
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/6.jpg not downloaded yet
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/7.jpg not downloaded yet
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/8.jpg not downloaded yet
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f96d0>
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/5.jpg saved to cache
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bff50>
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/8.jpg saved to cache
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cedd0>
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/8.jpg saved to cache
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838c510>
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/1.jpg saved to cache
2026-03-24 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cc550>
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/3.jpg saved to cache
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009146f10>
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/4.jpg saved to cache
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cd710>
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/10.jpg saved to cache
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/9.jpg not downloaded yet
2026-03-24 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/10.jpg not downloaded yet
2026-03-24 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:30 [ayvens.be] INFO: Found listing with ID: 1980398
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980398%27 HTTP/1.1" 200 None
2026-03-24 22:53:30 [ayvens.be] INFO: Scrape type for 1980398: 1
2026-03-24 22:53:30 [ayvens.be] INFO: Extracting data for car ID: 1980398
2026-03-24 22:53:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca90ab55-b05f-59cb-8ca9-e100eed25e9b with identifier: 1980398
2026-03-24 22:53:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b with scrape type 1
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/1.jpg not downloaded yet
2026-03-24 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/2.jpg not downloaded yet
2026-03-24 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/3.jpg not downloaded yet
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be4d0>
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/10.jpg saved to cache
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/4.jpg not downloaded yet
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/5.jpg not downloaded yet
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913db10>
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/10.jpg saved to cache
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018150>
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/1.jpg saved to cache
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095be590>
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/9.jpg saved to cache
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c2490>
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/8.jpg saved to cache
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096dd4d0>
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/7.jpg saved to cache
2026-03-24 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f690>
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/9.jpg saved to cache
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/6.jpg not downloaded yet
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/7.jpg not downloaded yet
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914f790>
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/7.jpg saved to cache
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/8.jpg not downloaded yet
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/9.jpg not downloaded yet
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/10.jpg not downloaded yet
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472310>
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/1.jpg saved to cache
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911ad90>
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/5.jpg saved to cache
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097618d0>
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/6.jpg saved to cache
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:31 [ayvens.be] INFO: Found listing with ID: 1980399
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980399%27 HTTP/1.1" 200 None
2026-03-24 22:53:31 [ayvens.be] INFO: Scrape type for 1980399: 1
2026-03-24 22:53:31 [ayvens.be] INFO: Extracting data for car ID: 1980399
2026-03-24 22:53:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1980399
2026-03-24 22:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed05e3d-f763-50bb-8774-2ad0b64eac8d with scrape type 1
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/1.jpg not downloaded yet
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3910>
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/4.jpg saved to cache
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/2.jpg not downloaded yet
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975a490>
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/6.jpg saved to cache
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872e50>
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/2.jpg saved to cache
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917ecd0>
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F713edc83f6cc499fba92d5b3dea05c26%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/6.jpg saved to cache
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d
2026-03-24 22:53:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ceb1d629-df7b-58ce-aa91-9dee573cbb0d, skipping ID generation
2026-03-24 22:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d with scrape type 1
2026-03-24 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d sending to next pipeline
2026-03-24 22:53:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ceb1d629-df7b-58ce-aa91-9dee573cbb0d, identifier: 1980395
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a89d0>
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252Ffb3ce7d8a19c490099f6470c46bc6159%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/3.jpg saved to cache
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4
2026-03-24 22:53:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4, skipping ID generation
2026-03-24 22:53:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with scrape type 1
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 sending to next pipeline
2026-03-24 22:53:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4, identifier: 1980396
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a550>
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/9.jpg saved to cache
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f8750>
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/8.jpg saved to cache
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838fa50>
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/7.jpg saved to cache
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/3.jpg not downloaded yet
2026-03-24 22:53:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1980395
2026-03-24 22:53:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1980395
2026-03-24 22:53:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1980395 to the API
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ceb1d629-df7b-58ce-aa91-9dee573cbb0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 82333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb1d629-df7b-58ce-aa91-9dee573cbb0d/ceb1d629-df7b-58ce-aa91-9dee573cbb0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/713edc83f6cc499fba92d5b3dea05c26/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980395%27 HTTP/1.1" 200 None
2026-03-24 22:53:32 [ayvens.be] INFO: Saving data for 1980395: {'created_time': 1774392812.937874, 'last_price_update_time': 1774392812.937883, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980395') HTTP/1.1" 204 0
2026-03-24 22:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1980396
2026-03-24 22:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1980396
2026-03-24 22:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1980396 to the API
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd509a2bd-3224-5aa1-a4e3-43f55bb7adc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 150951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d509a2bd-3224-5aa1-a4e3-43f55bb7adc4/d509a2bd-3224-5aa1-a4e3-43f55bb7adc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/fb3ce7d8a19c490099f6470c46bc6159/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318D (100KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318D (100KW) TOURING',
 'vin': None,
 'year': 2023}
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980396%27 HTTP/1.1" 200 None
2026-03-24 22:53:33 [ayvens.be] INFO: Saving data for 1980396: {'created_time': 1774392813.336512, 'last_price_update_time': 1774392813.336522, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980396') HTTP/1.1" 204 0
2026-03-24 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/4.jpg not downloaded yet
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/5.jpg not downloaded yet
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b9110>
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/10.jpg saved to cache
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fb750>
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/4.jpg saved to cache
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/6.jpg not downloaded yet
2026-03-24 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/7.jpg not downloaded yet
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b60d90>
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/5.jpg saved to cache
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/8.jpg not downloaded yet
2026-03-24 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/9.jpg not downloaded yet
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/10.jpg not downloaded yet
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091216d0>
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/1.jpg saved to cache
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009111550>
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/5.jpg saved to cache
2026-03-24 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008312d90>
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/4.jpg saved to cache
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:34 [ayvens.be] INFO: Found listing with ID: 1980400
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980400%27 HTTP/1.1" 200 None
2026-03-24 22:53:34 [ayvens.be] INFO: Scrape type for 1980400: 1
2026-03-24 22:53:34 [ayvens.be] INFO: Extracting data for car ID: 1980400
2026-03-24 22:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1980400
2026-03-24 22:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43bfe296-351d-5e28-8a25-5f5aae11d602 with scrape type 1
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/1.jpg not downloaded yet
2026-03-24 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/2.jpg not downloaded yet
2026-03-24 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fbe90>
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/2.jpg saved to cache
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8090>
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/3.jpg saved to cache
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/3.jpg not downloaded yet
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/4.jpg not downloaded yet
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/5.jpg not downloaded yet
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938d750>
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/7.jpg saved to cache
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772250>
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/3.jpg saved to cache
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b110>
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/6.jpg saved to cache
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0690>
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/8.jpg saved to cache
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091212d0>
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Faeba0ae40f154ab880d9f139883eac79%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/2.jpg saved to cache
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9
2026-03-24 22:53:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6d818fd-62ee-53d1-9d5d-90cebd6700d9, skipping ID generation
2026-03-24 22:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with scrape type 1
2026-03-24 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9 sending to next pipeline
2026-03-24 22:53:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6d818fd-62ee-53d1-9d5d-90cebd6700d9, identifier: 1980397
2026-03-24 22:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with identifier: 1980397
2026-03-24 22:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with identifier: 1980397
2026-03-24 22:53:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with identifier: 1980397 to the API
2026-03-24 22:53:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b6d818fd-62ee-53d1-9d5d-90cebd6700d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 104359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d818fd-62ee-53d1-9d5d-90cebd6700d9/b6d818fd-62ee-53d1-9d5d-90cebd6700d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/aeba0ae40f154ab880d9f139883eac79/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.0 TSI 81KW LIFE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE',
 'vin': None,
 'year': 2021}
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980397%27 HTTP/1.1" 200 None
2026-03-24 22:53:35 [ayvens.be] INFO: Saving data for 1980397: {'created_time': 1774392815.130066, 'last_price_update_time': 1774392815.130076, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980397') HTTP/1.1" 204 0
2026-03-24 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/6.jpg not downloaded yet
2026-03-24 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/7.jpg not downloaded yet
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aa3d0>
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F9134ce3748144228a3951be5ec35e5bd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/7.jpg saved to cache
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df095015-0ccb-5f99-b189-ce5e41de1ee3
2026-03-24 22:53:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df095015-0ccb-5f99-b189-ce5e41de1ee3, skipping ID generation
2026-03-24 22:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df095015-0ccb-5f99-b189-ce5e41de1ee3 with scrape type 1
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df095015-0ccb-5f99-b189-ce5e41de1ee3 sending to next pipeline
2026-03-24 22:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df095015-0ccb-5f99-b189-ce5e41de1ee3, identifier: 1980394
2026-03-24 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/8.jpg not downloaded yet
2026-03-24 22:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1980394
2026-03-24 22:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1980394
2026-03-24 22:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1980394 to the API
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'df095015-0ccb-5f99-b189-ce5e41de1ee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT GTE - 2020',
 'odometer': 92656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df095015-0ccb-5f99-b189-ce5e41de1ee3/df095015-0ccb-5f99-b189-ce5e41de1ee3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/9134ce3748144228a3951be5ec35e5bd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT GTE - 2020 1.4 TSI PHEV GTE Business DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV GTE Business DSG',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980394%27 HTTP/1.1" 200 None
2026-03-24 22:53:35 [ayvens.be] INFO: Saving data for 1980394: {'created_time': 1774392815.641581, 'last_price_update_time': 1774392815.641591, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980394') HTTP/1.1" 204 0
2026-03-24 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/9.jpg not downloaded yet
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094208d0>
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/9.jpg saved to cache
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ba950>
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F1bbe037c372a41aeb6b6a8eca2382668%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/10.jpg saved to cache
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b
2026-03-24 22:53:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca90ab55-b05f-59cb-8ca9-e100eed25e9b, skipping ID generation
2026-03-24 22:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b with scrape type 1
2026-03-24 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b sending to next pipeline
2026-03-24 22:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ca90ab55-b05f-59cb-8ca9-e100eed25e9b, identifier: 1980398
2026-03-24 22:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ca90ab55-b05f-59cb-8ca9-e100eed25e9b with identifier: 1980398
2026-03-24 22:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ca90ab55-b05f-59cb-8ca9-e100eed25e9b with identifier: 1980398
2026-03-24 22:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ca90ab55-b05f-59cb-8ca9-e100eed25e9b with identifier: 1980398 to the API
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ca90ab55-b05f-59cb-8ca9-e100eed25e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5Aircross',
 'odometer': 77826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca90ab55-b05f-59cb-8ca9-e100eed25e9b/ca90ab55-b05f-59cb-8ca9-e100eed25e9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/1bbe037c372a41aeb6b6a8eca2382668/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5Aircross 1.2 PURETECH 130 BUSINESS GPS',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 BUSINESS GPS',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980398%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [ayvens.be] INFO: Saving data for 1980398: {'created_time': 1774392816.208718, 'last_price_update_time': 1774392816.208728, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980398') HTTP/1.1" 204 0
2026-03-24 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/10.jpg not downloaded yet
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a2c10>
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/6.jpg saved to cache
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:36 [ayvens.be] INFO: Found listing with ID: 1980401
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980401%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [ayvens.be] INFO: Scrape type for 1980401: 1
2026-03-24 22:53:36 [ayvens.be] INFO: Extracting data for car ID: 1980401
2026-03-24 22:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1980401
2026-03-24 22:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d83f80e-b981-55eb-ba32-3dbbda630b16 with scrape type 1
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/1.jpg not downloaded yet
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a35d0>
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/1.jpg saved to cache
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970c7d0>
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/5.jpg saved to cache
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009566cd0>
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/2.jpg saved to cache
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096423d0>
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/6.jpg saved to cache
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/2.jpg not downloaded yet
2026-03-24 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/3.jpg not downloaded yet
2026-03-24 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/4.jpg not downloaded yet
2026-03-24 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/5.jpg not downloaded yet
2026-03-24 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/6.jpg not downloaded yet
2026-03-24 22:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/7.jpg not downloaded yet
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/8.jpg not downloaded yet
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/9.jpg not downloaded yet
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911df90>
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/10.jpg saved to cache
2026-03-24 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/10.jpg not downloaded yet
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914e5d0>
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/4.jpg saved to cache
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7010>
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/3.jpg saved to cache
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946ea10>
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/9.jpg saved to cache
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872610>
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/7.jpg saved to cache
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cf4d10>
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/5.jpg saved to cache
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317390>
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F29488130fec64075bf112d1c7858e701%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/8.jpg saved to cache
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eed05e3d-f763-50bb-8774-2ad0b64eac8d
2026-03-24 22:53:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eed05e3d-f763-50bb-8774-2ad0b64eac8d, skipping ID generation
2026-03-24 22:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed05e3d-f763-50bb-8774-2ad0b64eac8d with scrape type 1
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eed05e3d-f763-50bb-8774-2ad0b64eac8d sending to next pipeline
2026-03-24 22:53:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eed05e3d-f763-50bb-8774-2ad0b64eac8d, identifier: 1980399
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009941910>
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/1.jpg saved to cache
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:37 [ayvens.be] INFO: Found listing with ID: 1980402
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980402%27 HTTP/1.1" 200 None
2026-03-24 22:53:37 [ayvens.be] INFO: Scrape type for 1980402: 1
2026-03-24 22:53:37 [ayvens.be] INFO: Extracting data for car ID: 1980402
2026-03-24 22:53:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1980402
2026-03-24 22:53:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f96dd9-a309-5d3d-b9f0-8186628076bd with scrape type 1
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/1.jpg not downloaded yet
2026-03-24 22:53:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1980399
2026-03-24 22:53:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1980399
2026-03-24 22:53:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1980399 to the API
2026-03-24 22:53:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eed05e3d-f763-50bb-8774-2ad0b64eac8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 81231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed05e3d-f763-50bb-8774-2ad0b64eac8d/eed05e3d-f763-50bb-8774-2ad0b64eac8d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/29488130fec64075bf112d1c7858e701/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980399%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [ayvens.be] INFO: Saving data for 1980399: {'created_time': 1774392818.138905, 'last_price_update_time': 1774392818.138915, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980399') HTTP/1.1" 204 0
2026-03-24 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/2.jpg not downloaded yet
2026-03-24 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/3.jpg not downloaded yet
2026-03-24 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/4.jpg not downloaded yet
2026-03-24 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/5.jpg not downloaded yet
2026-03-24 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/6.jpg not downloaded yet
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/7.jpg not downloaded yet
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473350>
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/5.jpg saved to cache
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/8.jpg not downloaded yet
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760350>
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/7.jpg saved to cache
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/9.jpg not downloaded yet
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/10.jpg not downloaded yet
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910ecd0>
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/4.jpg saved to cache
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009863b90>
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/3.jpg saved to cache
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959df90>
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/9.jpg saved to cache
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945be90>
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/2.jpg saved to cache
2026-03-24 22:53:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2bf90>
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/6.jpg saved to cache
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945ae90>
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/8.jpg saved to cache
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:39 [ayvens.be] INFO: Found listing with ID: 1980403
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980403%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [ayvens.be] INFO: Scrape type for 1980403: 1
2026-03-24 22:53:39 [ayvens.be] INFO: Extracting data for car ID: 1980403
2026-03-24 22:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1980403
2026-03-24 22:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02602273-374d-59c0-8940-51e50b8740ed with scrape type 1
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/1.jpg not downloaded yet
2026-03-24 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/2.jpg not downloaded yet
2026-03-24 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/3.jpg not downloaded yet
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/4.jpg not downloaded yet
2026-03-24 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/5.jpg not downloaded yet
2026-03-24 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/6.jpg not downloaded yet
2026-03-24 22:53:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/7.jpg not downloaded yet
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/8.jpg not downloaded yet
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009140b90>
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/3.jpg saved to cache
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0d10>
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/2.jpg saved to cache
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/9.jpg not downloaded yet
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009133090>
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/1.jpg saved to cache
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cd8b10>
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252Fc53543a9539841eeac99a5b289029731%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/10.jpg saved to cache
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43bfe296-351d-5e28-8a25-5f5aae11d602
2026-03-24 22:53:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43bfe296-351d-5e28-8a25-5f5aae11d602, skipping ID generation
2026-03-24 22:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43bfe296-351d-5e28-8a25-5f5aae11d602 with scrape type 1
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43bfe296-351d-5e28-8a25-5f5aae11d602 sending to next pipeline
2026-03-24 22:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 43bfe296-351d-5e28-8a25-5f5aae11d602, identifier: 1980400
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f6410>
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/4.jpg saved to cache
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/10.jpg not downloaded yet
2026-03-24 22:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1980400
2026-03-24 22:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1980400
2026-03-24 22:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1980400 to the API
2026-03-24 22:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '43bfe296-351d-5e28-8a25-5f5aae11d602',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 53332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43bfe296-351d-5e28-8a25-5f5aae11d602/43bfe296-351d-5e28-8a25-5f5aae11d602_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/c53543a9539841eeac99a5b289029731/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980400%27 HTTP/1.1" 200 None
2026-03-24 22:53:40 [ayvens.be] INFO: Saving data for 1980400: {'created_time': 1774392820.108768, 'last_price_update_time': 1774392820.108777, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980400') HTTP/1.1" 204 0
2026-03-24 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:40 [ayvens.be] INFO: Found listing with ID: 1980404
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980404%27 HTTP/1.1" 200 None
2026-03-24 22:53:40 [ayvens.be] INFO: Scrape type for 1980404: 1
2026-03-24 22:53:40 [ayvens.be] INFO: Extracting data for car ID: 1980404
2026-03-24 22:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09913203-b771-5629-8a71-b1fb2bdfa726 with identifier: 1980404
2026-03-24 22:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09913203-b771-5629-8a71-b1fb2bdfa726 with scrape type 1
2026-03-24 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/1.jpg not downloaded yet
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a46d0>
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa0a22b9ba33c4384ab4d202d26b0a92b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/4.jpg saved to cache
2026-03-24 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 973b0b30-ae16-5993-8445-749a81894b5c
2026-03-24 22:53:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 973b0b30-ae16-5993-8445-749a81894b5c, skipping ID generation
2026-03-24 22:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973b0b30-ae16-5993-8445-749a81894b5c with scrape type 1
2026-03-24 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 973b0b30-ae16-5993-8445-749a81894b5c sending to next pipeline
2026-03-24 22:53:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 973b0b30-ae16-5993-8445-749a81894b5c, identifier: 1980390
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0d90>
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/5.jpg saved to cache
2026-03-24 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b6a50>
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/10.jpg saved to cache
2026-03-24 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1980390
2026-03-24 22:53:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1980390
2026-03-24 22:53:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1980390 to the API
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '973b0b30-ae16-5993-8445-749a81894b5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 128196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_973b0b30-ae16-5993-8445-749a81894b5c/973b0b30-ae16-5993-8445-749a81894b5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a0a22b9ba33c4384ab4d202d26b0a92b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW ST-LINE X AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW ST-LINE X AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980390%27 HTTP/1.1" 200 None
2026-03-24 22:53:40 [ayvens.be] INFO: Saving data for 1980390: {'created_time': 1774392820.984475, 'last_price_update_time': 1774392820.984485, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980390') HTTP/1.1" 204 0
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/2.jpg not downloaded yet
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/3.jpg not downloaded yet
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009719090>
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/1.jpg saved to cache
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b250>
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/3.jpg saved to cache
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/4.jpg not downloaded yet
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/5.jpg not downloaded yet
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347a50>
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/4.jpg saved to cache
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914c090>
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/9.jpg saved to cache
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/6.jpg not downloaded yet
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/7.jpg not downloaded yet
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835a610>
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/2.jpg saved to cache
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1b10>
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/9.jpg saved to cache
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915ec10>
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/7.jpg saved to cache
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c7f10>
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/10.jpg saved to cache
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/8.jpg not downloaded yet
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/9.jpg not downloaded yet
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/10.jpg not downloaded yet
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab250>
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/8.jpg saved to cache
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:41 [ayvens.be] INFO: Found listing with ID: 1980405
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980405%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [ayvens.be] INFO: Scrape type for 1980405: 1
2026-03-24 22:53:41 [ayvens.be] INFO: Extracting data for car ID: 1980405
2026-03-24 22:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1980405
2026-03-24 22:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0980ad47-8713-5737-b72e-7ea91ca5aa84 with scrape type 1
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/1.jpg not downloaded yet
2026-03-24 22:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/2.jpg not downloaded yet
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b81d0>
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/1.jpg saved to cache
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914cd50>
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/2.jpg saved to cache
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7a50>
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/8.jpg saved to cache
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/3.jpg not downloaded yet
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/4.jpg not downloaded yet
2026-03-24 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/5.jpg not downloaded yet
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097aaf50>
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/7.jpg saved to cache
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971a450>
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/4.jpg saved to cache
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/6.jpg not downloaded yet
2026-03-24 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/7.jpg not downloaded yet
2026-03-24 22:53:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008370550>
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/8.jpg saved to cache
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3410>
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/9.jpg saved to cache
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009771450>
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/10.jpg saved to cache
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/8.jpg not downloaded yet
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760fd0>
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/7.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/9.jpg not downloaded yet
2026-03-24 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/10.jpg not downloaded yet
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009667c10>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/1.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664d50>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/2.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009122bd0>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/3.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:43 [ayvens.be] INFO: Found listing with ID: 1980406
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980406%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [ayvens.be] INFO: Scrape type for 1980406: 1
2026-03-24 22:53:43 [ayvens.be] INFO: Extracting data for car ID: 1980406
2026-03-24 22:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3df23f13-e0ca-55cb-8368-423e6982df03 with identifier: 1980406
2026-03-24 22:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3df23f13-e0ca-55cb-8368-423e6982df03 with scrape type 1
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/1.jpg not downloaded yet
2026-03-24 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/2.jpg not downloaded yet
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c1b50>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/6.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091238d0>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/7.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/3.jpg not downloaded yet
2026-03-24 22:53:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/4.jpg not downloaded yet
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/5.jpg not downloaded yet
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008344d50>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/4.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008386a10>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/5.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008384210>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/9.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0090>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/10.jpg saved to cache
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/6.jpg not downloaded yet
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/7.jpg not downloaded yet
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fbb50>
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/6.jpg saved to cache
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938e510>
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F04780c5e968746d08fe6d39cde747185%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/8.jpg saved to cache
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09913203-b771-5629-8a71-b1fb2bdfa726
2026-03-24 22:53:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09913203-b771-5629-8a71-b1fb2bdfa726, skipping ID generation
2026-03-24 22:53:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09913203-b771-5629-8a71-b1fb2bdfa726 with scrape type 1
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09913203-b771-5629-8a71-b1fb2bdfa726 sending to next pipeline
2026-03-24 22:53:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09913203-b771-5629-8a71-b1fb2bdfa726, identifier: 1980404
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008313850>
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/5.jpg saved to cache
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/8.jpg not downloaded yet
2026-03-24 22:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09913203-b771-5629-8a71-b1fb2bdfa726 with identifier: 1980404
2026-03-24 22:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09913203-b771-5629-8a71-b1fb2bdfa726 with identifier: 1980404
2026-03-24 22:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09913203-b771-5629-8a71-b1fb2bdfa726 with identifier: 1980404 to the API
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '09913203-b771-5629-8a71-b1fb2bdfa726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 GRAN TOURER DIESEL - 2018',
 'odometer': 46905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09913203-b771-5629-8a71-b1fb2bdfa726/09913203-b771-5629-8a71-b1fb2bdfa726_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/04780c5e968746d08fe6d39cde747185/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'BMW 2 GRAN TOURER DIESEL - 2018 216 dA AdBlue',
 'transmission': 'automatic',
 'trim': '216 dA AdBlue',
 'vin': None,
 'year': 2020}
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980404%27 HTTP/1.1" 200 None
2026-03-24 22:53:44 [ayvens.be] INFO: Saving data for 1980404: {'created_time': 1774392824.843048, 'last_price_update_time': 1774392824.84306, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980404') HTTP/1.1" 204 0
2026-03-24 22:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/9.jpg not downloaded yet
2026-03-24 22:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/10.jpg not downloaded yet
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b1610>
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/4.jpg saved to cache
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:45 [ayvens.be] INFO: Found listing with ID: 1980407
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980407%27 HTTP/1.1" 200 None
2026-03-24 22:53:45 [ayvens.be] INFO: Scrape type for 1980407: 1
2026-03-24 22:53:45 [ayvens.be] INFO: Extracting data for car ID: 1980407
2026-03-24 22:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1980407
2026-03-24 22:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 966881a6-57ad-58a3-8bb5-1938c5357336 with scrape type 1
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/1.jpg not downloaded yet
2026-03-24 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/2.jpg not downloaded yet
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bf610>
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/3.jpg saved to cache
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405790>
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/6.jpg saved to cache
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009470a90>
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/5.jpg saved to cache
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4d50>
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/2.jpg saved to cache
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/3.jpg not downloaded yet
2026-03-24 22:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/4.jpg not downloaded yet
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/5.jpg not downloaded yet
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae450>
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/1.jpg saved to cache
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788050>
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F402a304d11eb420193050e375ddfead9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/3.jpg saved to cache
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02602273-374d-59c0-8940-51e50b8740ed
2026-03-24 22:53:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02602273-374d-59c0-8940-51e50b8740ed, skipping ID generation
2026-03-24 22:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02602273-374d-59c0-8940-51e50b8740ed with scrape type 1
2026-03-24 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02602273-374d-59c0-8940-51e50b8740ed sending to next pipeline
2026-03-24 22:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 02602273-374d-59c0-8940-51e50b8740ed, identifier: 1980403
2026-03-24 22:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1980403
2026-03-24 22:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1980403
2026-03-24 22:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1980403 to the API
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '02602273-374d-59c0-8940-51e50b8740ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 150035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 897300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02602273-374d-59c0-8940-51e50b8740ed/02602273-374d-59c0-8940-51e50b8740ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/402a304d11eb420193050e375ddfead9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980403%27 HTTP/1.1" 200 None
2026-03-24 22:53:46 [ayvens.be] INFO: Saving data for 1980403: {'created_time': 1774392826.081379, 'last_price_update_time': 1774392826.081389, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980403') HTTP/1.1" 204 0
2026-03-24 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/6.jpg not downloaded yet
2026-03-24 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/7.jpg not downloaded yet
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914ec50>
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/8.jpg saved to cache
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/8.jpg not downloaded yet
2026-03-24 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/9.jpg not downloaded yet
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3d50>
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/7.jpg saved to cache
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009789910>
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/6.jpg saved to cache
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/10.jpg not downloaded yet
2026-03-24 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:46 [ayvens.be] INFO: Found listing with ID: 1980408
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980408%27 HTTP/1.1" 200 None
2026-03-24 22:53:46 [ayvens.be] INFO: Scrape type for 1980408: 1
2026-03-24 22:53:46 [ayvens.be] INFO: Extracting data for car ID: 1980408
2026-03-24 22:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1980408
2026-03-24 22:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c41590c-6777-5c3e-bdc0-3649b66068c8 with scrape type 1
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/1.jpg not downloaded yet
2026-03-24 22:53:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a75d0>
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/9.jpg saved to cache
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc4910>
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F80e5c6b95331419fb12dce72a09cd769%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/5.jpg saved to cache
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3f96dd9-a309-5d3d-b9f0-8186628076bd
2026-03-24 22:53:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3f96dd9-a309-5d3d-b9f0-8186628076bd, skipping ID generation
2026-03-24 22:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f96dd9-a309-5d3d-b9f0-8186628076bd with scrape type 1
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3f96dd9-a309-5d3d-b9f0-8186628076bd sending to next pipeline
2026-03-24 22:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b3f96dd9-a309-5d3d-b9f0-8186628076bd, identifier: 1980402
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b79390>
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/2.jpg saved to cache
2026-03-24 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917f610>
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/1.jpg saved to cache
2026-03-24 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/2.jpg not downloaded yet
2026-03-24 22:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1980402
2026-03-24 22:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1980402
2026-03-24 22:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1980402 to the API
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b3f96dd9-a309-5d3d-b9f0-8186628076bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 50581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f96dd9-a309-5d3d-b9f0-8186628076bd/b3f96dd9-a309-5d3d-b9f0-8186628076bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/80e5c6b95331419fb12dce72a09cd769/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980402%27 HTTP/1.1" 200 None
2026-03-24 22:53:47 [ayvens.be] INFO: Saving data for 1980402: {'created_time': 1774392827.888634, 'last_price_update_time': 1774392827.888643, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980402') HTTP/1.1" 204 0
2026-03-24 22:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/3.jpg not downloaded yet
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/4.jpg not downloaded yet
2026-03-24 22:53:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7090>
2026-03-24 22:53:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F8370e9bbc3254eff9eac110ce55aa7b5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/10.jpg saved to cache
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0980ad47-8713-5737-b72e-7ea91ca5aa84
2026-03-24 22:53:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0980ad47-8713-5737-b72e-7ea91ca5aa84, skipping ID generation
2026-03-24 22:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0980ad47-8713-5737-b72e-7ea91ca5aa84 with scrape type 1
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0980ad47-8713-5737-b72e-7ea91ca5aa84 sending to next pipeline
2026-03-24 22:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0980ad47-8713-5737-b72e-7ea91ca5aa84, identifier: 1980405
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a2cd0>
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/3.jpg saved to cache
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1980405
2026-03-24 22:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1980405
2026-03-24 22:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1980405 to the API
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '0980ad47-8713-5737-b72e-7ea91ca5aa84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 106979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 996311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 951027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0980ad47-8713-5737-b72e-7ea91ca5aa84/0980ad47-8713-5737-b72e-7ea91ca5aa84_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 953391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/8370e9bbc3254eff9eac110ce55aa7b5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980405%27 HTTP/1.1" 200 None
2026-03-24 22:53:48 [ayvens.be] INFO: Saving data for 1980405: {'created_time': 1774392828.546752, 'last_price_update_time': 1774392828.546761, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980405') HTTP/1.1" 204 0
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/5.jpg not downloaded yet
2026-03-24 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/6.jpg not downloaded yet
2026-03-24 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835a910>
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/7.jpg saved to cache
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be2d0>
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/3.jpg saved to cache
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/7.jpg not downloaded yet
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/8.jpg not downloaded yet
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bd350>
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/6.jpg saved to cache
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4550>
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/8.jpg saved to cache
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008358310>
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/5.jpg saved to cache
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/9.jpg not downloaded yet
2026-03-24 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/10.jpg not downloaded yet
2026-03-24 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442450>
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/5.jpg saved to cache
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:49 [ayvens.be] INFO: Found listing with ID: 1980409
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980409%27 HTTP/1.1" 200 None
2026-03-24 22:53:49 [ayvens.be] INFO: Scrape type for 1980409: 1
2026-03-24 22:53:49 [ayvens.be] INFO: Extracting data for car ID: 1980409
2026-03-24 22:53:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1980409
2026-03-24 22:53:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f562b3c3-4465-58af-bad1-2ced11145b8e with scrape type 1
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/1.jpg not downloaded yet
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008311d50>
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/9.jpg saved to cache
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094647d0>
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/4.jpg saved to cache
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f6310>
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/6.jpg saved to cache
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/2.jpg not downloaded yet
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/3.jpg not downloaded yet
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bffd0>
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wh%252F52f2c4331c5143c5996cf6b2d3fdf3fe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/10.jpg saved to cache
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3df23f13-e0ca-55cb-8368-423e6982df03
2026-03-24 22:53:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3df23f13-e0ca-55cb-8368-423e6982df03, skipping ID generation
2026-03-24 22:53:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3df23f13-e0ca-55cb-8368-423e6982df03 with scrape type 1
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3df23f13-e0ca-55cb-8368-423e6982df03 sending to next pipeline
2026-03-24 22:53:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3df23f13-e0ca-55cb-8368-423e6982df03, identifier: 1980406
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb2690>
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/4.jpg saved to cache
2026-03-24 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b4890>
2026-03-24 22:53:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/7.jpg saved to cache
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472f50>
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/2.jpg saved to cache
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493250>
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/8.jpg saved to cache
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3df23f13-e0ca-55cb-8368-423e6982df03 with identifier: 1980406
2026-03-24 22:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3df23f13-e0ca-55cb-8368-423e6982df03 with identifier: 1980406
2026-03-24 22:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3df23f13-e0ca-55cb-8368-423e6982df03 with identifier: 1980406 to the API
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '3df23f13-e0ca-55cb-8368-423e6982df03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 172637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df23f13-e0ca-55cb-8368-423e6982df03/3df23f13-e0ca-55cb-8368-423e6982df03_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 945151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wh/52f2c4331c5143c5996cf6b2d3fdf3fe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 2.0 SDRIVE18D (100KW)',
 'transmission': 'manual',
 'trim': '2.0 SDRIVE18D (100KW)',
 'vin': None,
 'year': 2019}
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980406%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [ayvens.be] INFO: Saving data for 1980406: {'created_time': 1774392830.492646, 'last_price_update_time': 1774392830.492655, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980406') HTTP/1.1" 204 0
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/4.jpg not downloaded yet
2026-03-24 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/5.jpg not downloaded yet
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00833a610>
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/9.jpg saved to cache
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/6.jpg not downloaded yet
2026-03-24 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/7.jpg not downloaded yet
2026-03-24 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/8.jpg not downloaded yet
2026-03-24 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/9.jpg not downloaded yet
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959f750>
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/10.jpg saved to cache
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/10.jpg not downloaded yet
2026-03-24 22:53:50 [ayvens.be] INFO: Found listing with ID: 1980410
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980410%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [ayvens.be] INFO: Scrape type for 1980410: 1
2026-03-24 22:53:50 [ayvens.be] INFO: Extracting data for car ID: 1980410
2026-03-24 22:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1980410
2026-03-24 22:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b544de51-e016-5cb2-ad6d-11e0b9f81209 with scrape type 1
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/1.jpg not downloaded yet
2026-03-24 22:53:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c110>
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/2.jpg saved to cache
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b1dd0>
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/1.jpg saved to cache
2026-03-24 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009008b90>
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/3.jpg saved to cache
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121910>
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/4.jpg saved to cache
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/2.jpg not downloaded yet
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131850>
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/5.jpg saved to cache
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/3.jpg not downloaded yet
2026-03-24 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/4.jpg not downloaded yet
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008380e90>
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/6.jpg saved to cache
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009123510>
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2db%252Fa5fa5946a0e9409bb4b573d622f39dfd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/1.jpg saved to cache
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 966881a6-57ad-58a3-8bb5-1938c5357336
2026-03-24 22:53:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 966881a6-57ad-58a3-8bb5-1938c5357336, skipping ID generation
2026-03-24 22:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 966881a6-57ad-58a3-8bb5-1938c5357336 with scrape type 1
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 966881a6-57ad-58a3-8bb5-1938c5357336 sending to next pipeline
2026-03-24 22:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 966881a6-57ad-58a3-8bb5-1938c5357336, identifier: 1980407
2026-03-24 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1980407
2026-03-24 22:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1980407
2026-03-24 22:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1980407 to the API
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '966881a6-57ad-58a3-8bb5-1938c5357336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 48870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966881a6-57ad-58a3-8bb5-1938c5357336/966881a6-57ad-58a3-8bb5-1938c5357336_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2db/a5fa5946a0e9409bb4b573d622f39dfd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2023}
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980407%27 HTTP/1.1" 200 None
2026-03-24 22:53:51 [ayvens.be] INFO: Saving data for 1980407: {'created_time': 1774392831.83873, 'last_price_update_time': 1774392831.83874, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980407') HTTP/1.1" 204 0
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/5.jpg not downloaded yet
2026-03-24 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/6.jpg not downloaded yet
2026-03-24 22:53:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009773f90>
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/8.jpg saved to cache
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1c50>
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/7.jpg saved to cache
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/7.jpg not downloaded yet
2026-03-24 22:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/8.jpg not downloaded yet
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fbfd0>
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/1.jpg saved to cache
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564bd0>
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/2.jpg saved to cache
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910f1d0>
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/3.jpg saved to cache
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/9.jpg not downloaded yet
2026-03-24 22:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/10.jpg not downloaded yet
2026-03-24 22:53:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009758bd0>
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/9.jpg saved to cache
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cd98d0>
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2du%252Ff9ab801f458c45ffa5faae77df19cf04%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/6.jpg saved to cache
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d83f80e-b981-55eb-ba32-3dbbda630b16
2026-03-24 22:53:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d83f80e-b981-55eb-ba32-3dbbda630b16, skipping ID generation
2026-03-24 22:53:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d83f80e-b981-55eb-ba32-3dbbda630b16 with scrape type 1
2026-03-24 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d83f80e-b981-55eb-ba32-3dbbda630b16 sending to next pipeline
2026-03-24 22:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d83f80e-b981-55eb-ba32-3dbbda630b16, identifier: 1980401
2026-03-24 22:53:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009423510>
2026-03-24 22:53:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F46b1ad048f5c4fe2afcda4095c9e07a9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/10.jpg saved to cache
2026-03-24 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c41590c-6777-5c3e-bdc0-3649b66068c8
2026-03-24 22:53:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c41590c-6777-5c3e-bdc0-3649b66068c8, skipping ID generation
2026-03-24 22:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c41590c-6777-5c3e-bdc0-3649b66068c8 with scrape type 1
2026-03-24 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c41590c-6777-5c3e-bdc0-3649b66068c8 sending to next pipeline
2026-03-24 22:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c41590c-6777-5c3e-bdc0-3649b66068c8, identifier: 1980408
2026-03-24 22:53:53 [ayvens.be] INFO: Found listing with ID: 1980411
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980411%27 HTTP/1.1" 200 None
2026-03-24 22:53:53 [ayvens.be] INFO: Scrape type for 1980411: 1
2026-03-24 22:53:53 [ayvens.be] INFO: Extracting data for car ID: 1980411
2026-03-24 22:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1980411
2026-03-24 22:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768ee90d-9e68-5f82-b05d-5531b8607182 with scrape type 1
2026-03-24 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/1.jpg not downloaded yet
2026-03-24 22:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1980401
2026-03-24 22:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1980401
2026-03-24 22:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1980401 to the API
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '7d83f80e-b981-55eb-ba32-3dbbda630b16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 61618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 859135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d83f80e-b981-55eb-ba32-3dbbda630b16/7d83f80e-b981-55eb-ba32-3dbbda630b16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2du/f9ab801f458c45ffa5faae77df19cf04/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2023}
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980401%27 HTTP/1.1" 200 None
2026-03-24 22:53:53 [ayvens.be] INFO: Saving data for 1980401: {'created_time': 1774392833.567894, 'last_price_update_time': 1774392833.567903, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980401') HTTP/1.1" 204 0
2026-03-24 22:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1980408
2026-03-24 22:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1980408
2026-03-24 22:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1980408 to the API
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c41590c-6777-5c3e-bdc0-3649b66068c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 70763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c41590c-6777-5c3e-bdc0-3649b66068c8/8c41590c-6777-5c3e-bdc0-3649b66068c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/46b1ad048f5c4fe2afcda4095c9e07a9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980408%27 HTTP/1.1" 200 None
2026-03-24 22:53:53 [ayvens.be] INFO: Saving data for 1980408: {'created_time': 1774392833.89063, 'last_price_update_time': 1774392833.890639, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980408') HTTP/1.1" 204 0
2026-03-24 22:53:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/2.jpg not downloaded yet
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/3.jpg not downloaded yet
2026-03-24 22:53:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a310>
2026-03-24 22:53:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/4.jpg saved to cache
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913f1d0>
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/5.jpg saved to cache
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946f4d0>
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/6.jpg saved to cache
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913cd50>
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/7.jpg saved to cache
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/4.jpg not downloaded yet
2026-03-24 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/5.jpg not downloaded yet
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094646d0>
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/8.jpg saved to cache
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/6.jpg not downloaded yet
2026-03-24 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/7.jpg not downloaded yet
2026-03-24 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/8.jpg not downloaded yet
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008346f50>
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/9.jpg saved to cache
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009667190>
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F574f08c93a964c0b9941ce3ffe3b7ec8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/10.jpg saved to cache
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f562b3c3-4465-58af-bad1-2ced11145b8e
2026-03-24 22:53:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f562b3c3-4465-58af-bad1-2ced11145b8e, skipping ID generation
2026-03-24 22:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f562b3c3-4465-58af-bad1-2ced11145b8e with scrape type 1
2026-03-24 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f562b3c3-4465-58af-bad1-2ced11145b8e sending to next pipeline
2026-03-24 22:53:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f562b3c3-4465-58af-bad1-2ced11145b8e, identifier: 1980409
2026-03-24 22:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1980409
2026-03-24 22:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1980409
2026-03-24 22:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1980409 to the API
2026-03-24 22:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f562b3c3-4465-58af-bad1-2ced11145b8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 107173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f562b3c3-4465-58af-bad1-2ced11145b8e/f562b3c3-4465-58af-bad1-2ced11145b8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/574f08c93a964c0b9941ce3ffe3b7ec8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.6 PHEV 225 E-AUTO GT',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO GT',
 'vin': None,
 'year': 2021}
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980409%27 HTTP/1.1" 200 None
2026-03-24 22:53:55 [ayvens.be] INFO: Saving data for 1980409: {'created_time': 1774392835.180712, 'last_price_update_time': 1774392835.180722, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980409') HTTP/1.1" 204 0
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/9.jpg not downloaded yet
2026-03-24 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/10.jpg not downloaded yet
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0cd0>
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/3.jpg saved to cache
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a7090>
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/1.jpg saved to cache
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b9d0>
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/4.jpg saved to cache
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a96d0>
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/2.jpg saved to cache
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009448050>
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/5.jpg saved to cache
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:55 [ayvens.be] INFO: Found listing with ID: 1980412
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980412%27 HTTP/1.1" 200 None
2026-03-24 22:53:55 [ayvens.be] INFO: Scrape type for 1980412: 1
2026-03-24 22:53:55 [ayvens.be] INFO: Extracting data for car ID: 1980412
2026-03-24 22:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1980412
2026-03-24 22:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a with scrape type 1
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/1.jpg not downloaded yet
2026-03-24 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/2.jpg not downloaded yet
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009140b90>
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/6.jpg saved to cache
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/3.jpg not downloaded yet
2026-03-24 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/4.jpg not downloaded yet
2026-03-24 22:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b5a50>
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/7.jpg saved to cache
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/5.jpg not downloaded yet
2026-03-24 22:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/6.jpg not downloaded yet
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/7.jpg not downloaded yet
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008383850>
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/1.jpg saved to cache
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1dfa10>
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/2.jpg saved to cache
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/8.jpg not downloaded yet
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018313f90>
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/3.jpg saved to cache
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/9.jpg not downloaded yet
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab590>
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/9.jpg saved to cache
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975a410>
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/8.jpg saved to cache
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec7ed0>
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Facf44e0176554ed8a500bb805307340e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/10.jpg saved to cache
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b544de51-e016-5cb2-ad6d-11e0b9f81209
2026-03-24 22:53:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b544de51-e016-5cb2-ad6d-11e0b9f81209, skipping ID generation
2026-03-24 22:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b544de51-e016-5cb2-ad6d-11e0b9f81209 with scrape type 1
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b544de51-e016-5cb2-ad6d-11e0b9f81209 sending to next pipeline
2026-03-24 22:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b544de51-e016-5cb2-ad6d-11e0b9f81209, identifier: 1980410
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009941550>
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/4.jpg saved to cache
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/10.jpg not downloaded yet
2026-03-24 22:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1980410
2026-03-24 22:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1980410
2026-03-24 22:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1980410 to the API
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b544de51-e016-5cb2-ad6d-11e0b9f81209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE BERLINE',
 'odometer': 38448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 866189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b544de51-e016-5cb2-ad6d-11e0b9f81209/b544de51-e016-5cb2-ad6d-11e0b9f81209_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/acf44e0176554ed8a500bb805307340e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE BERLINE 1.6 E-TECH 160 PHEV INTENS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 160 PHEV INTENS',
 'vin': None,
 'year': 2022}
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980410%27 HTTP/1.1" 200 None
2026-03-24 22:53:57 [ayvens.be] INFO: Saving data for 1980410: {'created_time': 1774392837.220545, 'last_price_update_time': 1774392837.220556, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980410') HTTP/1.1" 204 0
2026-03-24 22:53:57 [ayvens.be] INFO: Found listing with ID: 1980413
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980413%27 HTTP/1.1" 200 None
2026-03-24 22:53:57 [ayvens.be] INFO: Scrape type for 1980413: 1
2026-03-24 22:53:57 [ayvens.be] INFO: Extracting data for car ID: 1980413
2026-03-24 22:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1980413
2026-03-24 22:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1633be65-fc75-5ecc-9ded-a75cce69d482 with scrape type 1
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/1.jpg not downloaded yet
2026-03-24 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/2.jpg not downloaded yet
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009466210>
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/5.jpg saved to cache
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/3.jpg not downloaded yet
2026-03-24 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/4.jpg not downloaded yet
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b27c110>
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/9.jpg saved to cache
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/5.jpg not downloaded yet
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/6.jpg not downloaded yet
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/7.jpg not downloaded yet
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a29690>
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/8.jpg saved to cache
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009459810>
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/6.jpg saved to cache
2026-03-24 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839a150>
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/2.jpg saved to cache
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097898d0>
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/7.jpg saved to cache
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3990>
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F727a388f7bb04b2ab2958cb5539a4c6f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/10.jpg saved to cache
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 768ee90d-9e68-5f82-b05d-5531b8607182
2026-03-24 22:53:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 768ee90d-9e68-5f82-b05d-5531b8607182, skipping ID generation
2026-03-24 22:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768ee90d-9e68-5f82-b05d-5531b8607182 with scrape type 1
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 768ee90d-9e68-5f82-b05d-5531b8607182 sending to next pipeline
2026-03-24 22:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 768ee90d-9e68-5f82-b05d-5531b8607182, identifier: 1980411
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009940690>
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/1.jpg saved to cache
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1980411
2026-03-24 22:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1980411
2026-03-24 22:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1980411 to the API
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '768ee90d-9e68-5f82-b05d-5531b8607182',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 119366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768ee90d-9e68-5f82-b05d-5531b8607182/768ee90d-9e68-5f82-b05d-5531b8607182_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/727a388f7bb04b2ab2958cb5539a4c6f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2020}
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980411%27 HTTP/1.1" 200 None
2026-03-24 22:53:58 [ayvens.be] INFO: Saving data for 1980411: {'created_time': 1774392838.789385, 'last_price_update_time': 1774392838.789394, 'auction_closing_time': 1774530000.0}
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980411') HTTP/1.1" 204 0
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/8.jpg not downloaded yet
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/9.jpg not downloaded yet
2026-03-24 22:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c9610>
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/3.jpg saved to cache
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/10.jpg not downloaded yet
2026-03-24 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:59 [ayvens.be] INFO: Found listing with ID: 1980414
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980414%27 HTTP/1.1" 200 None
2026-03-24 22:53:59 [ayvens.be] INFO: Scrape type for 1980414: 1
2026-03-24 22:53:59 [ayvens.be] INFO: Extracting data for car ID: 1980414
2026-03-24 22:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1980414
2026-03-24 22:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69645680-dd88-54d6-bb22-6e98fa48909c with scrape type 1
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/1.jpg not downloaded yet
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643050>
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/6.jpg saved to cache
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/2.jpg not downloaded yet
2026-03-24 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/3.jpg not downloaded yet
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c8490>
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/7.jpg saved to cache
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975b550>
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/4.jpg saved to cache
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a9090>
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/9.jpg saved to cache
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1110>
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/5.jpg saved to cache
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/4.jpg not downloaded yet
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/5.jpg not downloaded yet
2026-03-24 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/6.jpg not downloaded yet
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aafd0>
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/8.jpg saved to cache
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359d10>
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:53:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F4b79760569d54a988670a333c14ca8d3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/10.jpg saved to cache
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a
2026-03-24 22:53:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15f5a42c-df82-58fa-8fd9-3104414d6d3a, skipping ID generation
2026-03-24 22:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a with scrape type 1
2026-03-24 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a sending to next pipeline
2026-03-24 22:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 15f5a42c-df82-58fa-8fd9-3104414d6d3a, identifier: 1980412
2026-03-24 22:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1980412
2026-03-24 22:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1980412
2026-03-24 22:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1980412 to the API
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '15f5a42c-df82-58fa-8fd9-3104414d6d3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 148205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f5a42c-df82-58fa-8fd9-3104414d6d3a/15f5a42c-df82-58fa-8fd9-3104414d6d3a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/4b79760569d54a988670a333c14ca8d3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI PLATINUM DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI PLATINUM DSG',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980412%27 HTTP/1.1" 200 None
2026-03-24 22:54:00 [ayvens.be] INFO: Saving data for 1980412: {'created_time': 1774392840.27482, 'last_price_update_time': 1774392840.274829, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980412') HTTP/1.1" 204 0
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/7.jpg not downloaded yet
2026-03-24 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/8.jpg not downloaded yet
2026-03-24 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ab150>
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/1.jpg saved to cache
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8910>
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/3.jpg saved to cache
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/9.jpg not downloaded yet
2026-03-24 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/10.jpg not downloaded yet
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145ed0>
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/2.jpg saved to cache
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975bc10>
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/4.jpg saved to cache
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009667150>
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/6.jpg saved to cache
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975a490>
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/5.jpg saved to cache
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:00 [ayvens.be] INFO: Found listing with ID: 1980415
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980415%27 HTTP/1.1" 200 None
2026-03-24 22:54:00 [ayvens.be] INFO: Scrape type for 1980415: 1
2026-03-24 22:54:00 [ayvens.be] INFO: Extracting data for car ID: 1980415
2026-03-24 22:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1980415
2026-03-24 22:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with scrape type 1
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/1.jpg not downloaded yet
2026-03-24 22:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/2.jpg not downloaded yet
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009012750>
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/7.jpg saved to cache
2026-03-24 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008399390>
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/8.jpg saved to cache
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/3.jpg not downloaded yet
2026-03-24 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/4.jpg not downloaded yet
2026-03-24 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/5.jpg not downloaded yet
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a4d0>
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/9.jpg saved to cache
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/6.jpg not downloaded yet
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/7.jpg not downloaded yet
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911b490>
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F6382c1a8a1f440ccacf89603ba95eb82%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/10.jpg saved to cache
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1633be65-fc75-5ecc-9ded-a75cce69d482
2026-03-24 22:54:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1633be65-fc75-5ecc-9ded-a75cce69d482, skipping ID generation
2026-03-24 22:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1633be65-fc75-5ecc-9ded-a75cce69d482 with scrape type 1
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1633be65-fc75-5ecc-9ded-a75cce69d482 sending to next pipeline
2026-03-24 22:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1633be65-fc75-5ecc-9ded-a75cce69d482, identifier: 1980413
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959c1d0>
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/2.jpg saved to cache
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639b90>
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/1.jpg saved to cache
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962da10>
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/3.jpg saved to cache
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/8.jpg not downloaded yet
2026-03-24 22:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1980413
2026-03-24 22:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1980413
2026-03-24 22:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1980413 to the API
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '1633be65-fc75-5ecc-9ded-a75cce69d482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 82439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1633be65-fc75-5ecc-9ded-a75cce69d482/1633be65-fc75-5ecc-9ded-a75cce69d482_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/6382c1a8a1f440ccacf89603ba95eb82/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980413%27 HTTP/1.1" 200 None
2026-03-24 22:54:02 [ayvens.be] INFO: Saving data for 1980413: {'created_time': 1774392842.052515, 'last_price_update_time': 1774392842.052529, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980413') HTTP/1.1" 204 0
2026-03-24 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/9.jpg not downloaded yet
2026-03-24 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/10.jpg not downloaded yet
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096115d0>
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/4.jpg saved to cache
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095efdd0>
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/6.jpg saved to cache
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:02 [ayvens.be] INFO: Found listing with ID: 1980416
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980416%27 HTTP/1.1" 200 None
2026-03-24 22:54:02 [ayvens.be] INFO: Scrape type for 1980416: 1
2026-03-24 22:54:02 [ayvens.be] INFO: Extracting data for car ID: 1980416
2026-03-24 22:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1980416
2026-03-24 22:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b18b9c8-f038-5154-8774-01efdde72620 with scrape type 1
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/1.jpg not downloaded yet
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/2.jpg not downloaded yet
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911bd50>
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/5.jpg saved to cache
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317990>
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/7.jpg saved to cache
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983a110>
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/10.jpg saved to cache
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/3.jpg not downloaded yet
2026-03-24 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/4.jpg not downloaded yet
2026-03-24 22:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/5.jpg not downloaded yet
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c4850>
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/9.jpg saved to cache
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911a190>
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F18655f4c847a468492ff0f891c9d9238%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/8.jpg saved to cache
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69645680-dd88-54d6-bb22-6e98fa48909c
2026-03-24 22:54:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69645680-dd88-54d6-bb22-6e98fa48909c, skipping ID generation
2026-03-24 22:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69645680-dd88-54d6-bb22-6e98fa48909c with scrape type 1
2026-03-24 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69645680-dd88-54d6-bb22-6e98fa48909c sending to next pipeline
2026-03-24 22:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 69645680-dd88-54d6-bb22-6e98fa48909c, identifier: 1980414
2026-03-24 22:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1980414
2026-03-24 22:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1980414
2026-03-24 22:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1980414 to the API
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '69645680-dd88-54d6-bb22-6e98fa48909c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 98878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69645680-dd88-54d6-bb22-6e98fa48909c/69645680-dd88-54d6-bb22-6e98fa48909c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/18655f4c847a468492ff0f891c9d9238/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 200KW XDRIVE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 200KW XDRIVE AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980414%27 HTTP/1.1" 200 None
2026-03-24 22:54:03 [ayvens.be] INFO: Saving data for 1980414: {'created_time': 1774392843.229122, 'last_price_update_time': 1774392843.229132, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980414') HTTP/1.1" 204 0
2026-03-24 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/6.jpg not downloaded yet
2026-03-24 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/7.jpg not downloaded yet
2026-03-24 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009612fd0>
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/1.jpg saved to cache
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009192a90>
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/2.jpg saved to cache
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f7d0>
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/5.jpg saved to cache
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/8.jpg not downloaded yet
2026-03-24 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/9.jpg not downloaded yet
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083141d0>
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/3.jpg saved to cache
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094671d0>
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/4.jpg saved to cache
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643b10>
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/6.jpg saved to cache
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/10.jpg not downloaded yet
2026-03-24 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:03 [ayvens.be] INFO: Found listing with ID: 1980417
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980417%27 HTTP/1.1" 200 None
2026-03-24 22:54:03 [ayvens.be] INFO: Scrape type for 1980417: 1
2026-03-24 22:54:03 [ayvens.be] INFO: Extracting data for car ID: 1980417
2026-03-24 22:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1980417
2026-03-24 22:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c64d60-2a63-590b-be74-1f96dd9673c1 with scrape type 1
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/1.jpg not downloaded yet
2026-03-24 22:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009404f50>
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/7.jpg saved to cache
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945b1d0>
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/8.jpg saved to cache
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/2.jpg not downloaded yet
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613810>
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/9.jpg saved to cache
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4c50>
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F521f310bc07949e39c871ce74861474b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/10.jpg saved to cache
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19
2026-03-24 22:54:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19, skipping ID generation
2026-03-24 22:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with scrape type 1
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 sending to next pipeline
2026-03-24 22:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19, identifier: 1980415
2026-03-24 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/3.jpg not downloaded yet
2026-03-24 22:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1980415
2026-03-24 22:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1980415
2026-03-24 22:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1980415 to the API
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8580ac67-a34c-5f62-8fe2-1d5c6cfeef19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 150736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8580ac67-a34c-5f62-8fe2-1d5c6cfeef19/8580ac67-a34c-5f62-8fe2-1d5c6cfeef19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/521f310bc07949e39c871ce74861474b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI ACT Ambition',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Ambition',
 'vin': None,
 'year': 2020}
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980415%27 HTTP/1.1" 200 None
2026-03-24 22:54:04 [ayvens.be] INFO: Saving data for 1980415: {'created_time': 1774392844.826869, 'last_price_update_time': 1774392844.82688, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980415') HTTP/1.1" 204 0
2026-03-24 22:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/4.jpg not downloaded yet
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d41d0>
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/1.jpg saved to cache
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/5.jpg not downloaded yet
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a6d10>
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/3.jpg saved to cache
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/6.jpg not downloaded yet
2026-03-24 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7e90>
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/2.jpg saved to cache
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/7.jpg not downloaded yet
2026-03-24 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/8.jpg not downloaded yet
2026-03-24 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/9.jpg not downloaded yet
2026-03-24 22:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834e690>
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/4.jpg saved to cache
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d6850>
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/5.jpg saved to cache
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/10.jpg not downloaded yet
2026-03-24 22:54:05 [ayvens.be] INFO: Found listing with ID: 1980418
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980418%27 HTTP/1.1" 200 None
2026-03-24 22:54:05 [ayvens.be] INFO: Scrape type for 1980418: 1
2026-03-24 22:54:05 [ayvens.be] INFO: Extracting data for car ID: 1980418
2026-03-24 22:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with identifier: 1980418
2026-03-24 22:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with scrape type 1
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/1.jpg not downloaded yet
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce310>
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/6.jpg saved to cache
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638c90>
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/7.jpg saved to cache
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613790>
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/9.jpg saved to cache
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945be50>
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/8.jpg saved to cache
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009758090>
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F0a0a3d7cdc5145b8b66c6036a570d501%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/10.jpg saved to cache
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b18b9c8-f038-5154-8774-01efdde72620
2026-03-24 22:54:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b18b9c8-f038-5154-8774-01efdde72620, skipping ID generation
2026-03-24 22:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b18b9c8-f038-5154-8774-01efdde72620 with scrape type 1
2026-03-24 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b18b9c8-f038-5154-8774-01efdde72620 sending to next pipeline
2026-03-24 22:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b18b9c8-f038-5154-8774-01efdde72620, identifier: 1980416
2026-03-24 22:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1980416
2026-03-24 22:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1980416
2026-03-24 22:54:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1980416 to the API
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '2b18b9c8-f038-5154-8774-01efdde72620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 52411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b18b9c8-f038-5154-8774-01efdde72620/2b18b9c8-f038-5154-8774-01efdde72620_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/0a0a3d7cdc5145b8b66c6036a570d501/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980416%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [ayvens.be] INFO: Saving data for 1980416: {'created_time': 1774392846.319551, 'last_price_update_time': 1774392846.31956, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980416') HTTP/1.1" 204 0
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/2.jpg not downloaded yet
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/3.jpg not downloaded yet
2026-03-24 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/4.jpg not downloaded yet
2026-03-24 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/5.jpg not downloaded yet
2026-03-24 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/6.jpg not downloaded yet
2026-03-24 22:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/7.jpg not downloaded yet
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/8.jpg not downloaded yet
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/9.jpg not downloaded yet
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970e010>
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/2.jpg saved to cache
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00919a5d0>
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/1.jpg saved to cache
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/10.jpg not downloaded yet
2026-03-24 22:54:06 [scrapy.extensions.logstats] INFO: Crawled 12 pages (at 6 pages/min), scraped 406 items (at 35 items/min)
2026-03-24 22:54:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bfbd0>
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/7.jpg saved to cache
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:06 [ayvens.be] INFO: Found listing with ID: 1980419
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980419%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [ayvens.be] INFO: Scrape type for 1980419: 1
2026-03-24 22:54:06 [ayvens.be] INFO: Extracting data for car ID: 1980419
2026-03-24 22:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1980419
2026-03-24 22:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a224006a-ecb1-5777-9c36-19cb2bd63777 with scrape type 1
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/1.jpg not downloaded yet
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a99d0>
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/4.jpg saved to cache
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b85d0>
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/5.jpg saved to cache
2026-03-24 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008342410>
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/3.jpg saved to cache
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009860650>
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/6.jpg saved to cache
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b62ad0>
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/8.jpg saved to cache
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/2.jpg not downloaded yet
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/3.jpg not downloaded yet
2026-03-24 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/4.jpg not downloaded yet
2026-03-24 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/5.jpg not downloaded yet
2026-03-24 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/6.jpg not downloaded yet
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec77d0>
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/9.jpg saved to cache
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/7.jpg not downloaded yet
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946ce10>
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/2.jpg saved to cache
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/8.jpg not downloaded yet
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/9.jpg not downloaded yet
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8850>
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/3.jpg saved to cache
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131ed0>
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/4.jpg saved to cache
2026-03-24 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeaf610>
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F6564954f6d4e445ab076a0ab3d782a3a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/10.jpg saved to cache
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91c64d60-2a63-590b-be74-1f96dd9673c1
2026-03-24 22:54:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91c64d60-2a63-590b-be74-1f96dd9673c1, skipping ID generation
2026-03-24 22:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c64d60-2a63-590b-be74-1f96dd9673c1 with scrape type 1
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91c64d60-2a63-590b-be74-1f96dd9673c1 sending to next pipeline
2026-03-24 22:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91c64d60-2a63-590b-be74-1f96dd9673c1, identifier: 1980417
2026-03-24 22:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1a8950>
2026-03-24 22:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/1.jpg saved to cache
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1980417
2026-03-24 22:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1980417
2026-03-24 22:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1980417 to the API
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '91c64d60-2a63-590b-be74-1f96dd9673c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 117173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91c64d60-2a63-590b-be74-1f96dd9673c1/91c64d60-2a63-590b-be74-1f96dd9673c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/6564954f6d4e445ab076a0ab3d782a3a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2020}
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980417%27 HTTP/1.1" 200 None
2026-03-24 22:54:08 [ayvens.be] INFO: Saving data for 1980417: {'created_time': 1774392848.655356, 'last_price_update_time': 1774392848.655366, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980417') HTTP/1.1" 204 0
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/10.jpg not downloaded yet
2026-03-24 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:08 [ayvens.be] INFO: Found listing with ID: 1980420
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980420%27 HTTP/1.1" 200 None
2026-03-24 22:54:08 [ayvens.be] INFO: Scrape type for 1980420: 1
2026-03-24 22:54:08 [ayvens.be] INFO: Extracting data for car ID: 1980420
2026-03-24 22:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1980420
2026-03-24 22:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with scrape type 1
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/1.jpg not downloaded yet
2026-03-24 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/2.jpg not downloaded yet
2026-03-24 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/3.jpg not downloaded yet
2026-03-24 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/4.jpg not downloaded yet
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/5.jpg not downloaded yet
2026-03-24 22:54:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f87d0>
2026-03-24 22:54:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/7.jpg saved to cache
2026-03-24 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/6.jpg not downloaded yet
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119850>
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/10.jpg saved to cache
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b990>
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/8.jpg saved to cache
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b94d0>
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/5.jpg saved to cache
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975a9d0>
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/6.jpg saved to cache
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838f210>
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4fc362a77a46eaa9ea763f9823ae5c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/9.jpg saved to cache
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90
2026-03-24 22:54:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90, skipping ID generation
2026-03-24 22:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with scrape type 1
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 sending to next pipeline
2026-03-24 22:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90, identifier: 1980418
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b5ed0>
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/1.jpg saved to cache
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bd990>
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/2.jpg saved to cache
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/7.jpg not downloaded yet
2026-03-24 22:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with identifier: 1980418
2026-03-24 22:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with identifier: 1980418
2026-03-24 22:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with identifier: 1980418 to the API
2026-03-24 22:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 46869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90/c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4fc362a77a46eaa9ea763f9823ae5c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse 1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980418%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [ayvens.be] INFO: Saving data for 1980418: {'created_time': 1774392850.133425, 'last_price_update_time': 1774392850.133434, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980418') HTTP/1.1" 204 0
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/8.jpg not downloaded yet
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/9.jpg not downloaded yet
2026-03-24 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/10.jpg not downloaded yet
2026-03-24 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:10 [ayvens.be] INFO: Found listing with ID: 1980421
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980421%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [ayvens.be] INFO: Scrape type for 1980421: 1
2026-03-24 22:54:10 [ayvens.be] INFO: Extracting data for car ID: 1980421
2026-03-24 22:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1980421
2026-03-24 22:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bc6fecf-167b-51eb-acbf-41d488f8f507 with scrape type 1
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/1.jpg not downloaded yet
2026-03-24 22:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/2.jpg not downloaded yet
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/3.jpg not downloaded yet
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/4.jpg not downloaded yet
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830b6d0>
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/5.jpg saved to cache
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945a2d0>
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/6.jpg saved to cache
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cef90>
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/10.jpg saved to cache
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/5.jpg not downloaded yet
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008380c90>
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/4.jpg saved to cache
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a2050>
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/3.jpg saved to cache
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a0c10>
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/7.jpg saved to cache
2026-03-24 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083839d0>
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/9.jpg saved to cache
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/6.jpg not downloaded yet
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/7.jpg not downloaded yet
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009141550>
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6bc40b7881664a708b12a673ad746f9b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/8.jpg saved to cache
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a224006a-ecb1-5777-9c36-19cb2bd63777
2026-03-24 22:54:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a224006a-ecb1-5777-9c36-19cb2bd63777, skipping ID generation
2026-03-24 22:54:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a224006a-ecb1-5777-9c36-19cb2bd63777 with scrape type 1
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a224006a-ecb1-5777-9c36-19cb2bd63777 sending to next pipeline
2026-03-24 22:54:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a224006a-ecb1-5777-9c36-19cb2bd63777, identifier: 1980419
2026-03-24 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1980419
2026-03-24 22:54:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1980419
2026-03-24 22:54:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1980419 to the API
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a224006a-ecb1-5777-9c36-19cb2bd63777',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 80986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a224006a-ecb1-5777-9c36-19cb2bd63777/a224006a-ecb1-5777-9c36-19cb2bd63777_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6bc40b7881664a708b12a673ad746f9b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980419%27 HTTP/1.1" 200 None
2026-03-24 22:54:11 [ayvens.be] INFO: Saving data for 1980419: {'created_time': 1774392851.579217, 'last_price_update_time': 1774392851.579229, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980419') HTTP/1.1" 204 0
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/8.jpg not downloaded yet
2026-03-24 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/9.jpg not downloaded yet
2026-03-24 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009763310>
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/7.jpg saved to cache
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/10.jpg not downloaded yet
2026-03-24 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:11 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-24 22:54:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838c050>
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/1.jpg saved to cache
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009459c50>
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/5.jpg saved to cache
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096416d0>
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/3.jpg saved to cache
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a2950>
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/6.jpg saved to cache
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bc950>
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/4.jpg saved to cache
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f5a90>
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/2.jpg saved to cache
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a26d0>
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/8.jpg saved to cache
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff017676d10>
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/10.jpg saved to cache
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097739d0>
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252F3a0f419004e34cfdadee07247b8526f5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/9.jpg saved to cache
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362
2026-03-24 22:54:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8a785fe-b5d0-56fa-83f9-4fab89d7a362, skipping ID generation
2026-03-24 22:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with scrape type 1
2026-03-24 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 sending to next pipeline
2026-03-24 22:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b8a785fe-b5d0-56fa-83f9-4fab89d7a362, identifier: 1980420
2026-03-24 22:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1980420
2026-03-24 22:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1980420
2026-03-24 22:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1980420 to the API
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b8a785fe-b5d0-56fa-83f9-4fab89d7a362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 83009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a785fe-b5d0-56fa-83f9-4fab89d7a362/b8a785fe-b5d0-56fa-83f9-4fab89d7a362_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/3a0f419004e34cfdadee07247b8526f5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980420%27 HTTP/1.1" 200 None
2026-03-24 22:54:13 [ayvens.be] INFO: Saving data for 1980420: {'created_time': 1774392853.299853, 'last_price_update_time': 1774392853.299862, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980420') HTTP/1.1" 204 0
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4d50>
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/4.jpg saved to cache
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336710>
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/5.jpg saved to cache
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d5350>
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/2.jpg saved to cache
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d4d10>
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/1.jpg saved to cache
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d4d50>
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/3.jpg saved to cache
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009792ad0>
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/6.jpg saved to cache
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d5550>
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/7.jpg saved to cache
2026-03-24 22:54:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8690>
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/8.jpg saved to cache
2026-03-24 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fbd90>
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/9.jpg saved to cache
2026-03-24 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d01ad0>
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5195dd5d4b034de5a00dae8d162dd358%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/10.jpg saved to cache
2026-03-24 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0bc6fecf-167b-51eb-acbf-41d488f8f507
2026-03-24 22:54:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0bc6fecf-167b-51eb-acbf-41d488f8f507, skipping ID generation
2026-03-24 22:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bc6fecf-167b-51eb-acbf-41d488f8f507 with scrape type 1
2026-03-24 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0bc6fecf-167b-51eb-acbf-41d488f8f507 sending to next pipeline
2026-03-24 22:54:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0bc6fecf-167b-51eb-acbf-41d488f8f507, identifier: 1980421
2026-03-24 22:54:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1980421
2026-03-24 22:54:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1980421
2026-03-24 22:54:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1980421 to the API
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0bc6fecf-167b-51eb-acbf-41d488f8f507',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPE',
 'odometer': 111879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 838015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bc6fecf-167b-51eb-acbf-41d488f8f507/0bc6fecf-167b-51eb-acbf-41d488f8f507_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5195dd5d4b034de5a00dae8d162dd358/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPE 2.0 GLC 300 DE PHEV 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE PHEV 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980421%27 HTTP/1.1" 200 None
2026-03-24 22:54:14 [ayvens.be] INFO: Saving data for 1980421: {'created_time': 1774392854.740924, 'last_price_update_time': 1774392854.740933, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980421') HTTP/1.1" 204 0
2026-03-24 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:54:15 [ayvens.be] INFO: Found listing with ID: 1980422
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980422%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [ayvens.be] INFO: Scrape type for 1980422: 1
2026-03-24 22:54:15 [ayvens.be] INFO: Extracting data for car ID: 1980422
2026-03-24 22:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1980422
2026-03-24 22:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with scrape type 1
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/1.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/2.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/3.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/4.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/5.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/6.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/7.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/8.jpg not downloaded yet
2026-03-24 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/9.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/10.jpg not downloaded yet
2026-03-24 22:54:15 [ayvens.be] INFO: Found listing with ID: 1980423
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980423%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [ayvens.be] INFO: Scrape type for 1980423: 1
2026-03-24 22:54:15 [ayvens.be] INFO: Extracting data for car ID: 1980423
2026-03-24 22:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1980423
2026-03-24 22:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09004bbc-6359-535b-a99e-b8b1fb675399 with scrape type 1
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/1.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/2.jpg not downloaded yet
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/3.jpg not downloaded yet
2026-03-24 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/4.jpg not downloaded yet
2026-03-24 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bb9a910>
2026-03-24 22:54:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/1.jpg saved to cache
2026-03-24 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/5.jpg not downloaded yet
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/6.jpg not downloaded yet
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/7.jpg not downloaded yet
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008314d10>
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/6.jpg saved to cache
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/8.jpg not downloaded yet
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009423d90>
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/7.jpg saved to cache
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971b610>
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/5.jpg saved to cache
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/9.jpg not downloaded yet
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009143e50>
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/2.jpg saved to cache
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967dc90>
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/8.jpg saved to cache
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be050>
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/3.jpg saved to cache
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0196da9d0>
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/9.jpg saved to cache
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009762090>
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/4.jpg saved to cache
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/10.jpg not downloaded yet
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [ayvens.be] INFO: Found listing with ID: 1980424
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980424%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [ayvens.be] INFO: Scrape type for 1980424: 1
2026-03-24 22:54:16 [ayvens.be] INFO: Extracting data for car ID: 1980424
2026-03-24 22:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1980424
2026-03-24 22:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with scrape type 1
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/1.jpg not downloaded yet
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/2.jpg not downloaded yet
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/3.jpg not downloaded yet
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/4.jpg not downloaded yet
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/5.jpg not downloaded yet
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0850>
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fc11dcd5a9d684d1aa607143430a0bb00%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/10.jpg saved to cache
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea
2026-03-24 22:54:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea, skipping ID generation
2026-03-24 22:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with scrape type 1
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea sending to next pipeline
2026-03-24 22:54:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea, identifier: 1980422
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/6.jpg not downloaded yet
2026-03-24 22:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1980422
2026-03-24 22:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1980422
2026-03-24 22:54:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1980422 to the API
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1e64cf68-a5f0-53b0-94d5-05c292bbbcea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 147558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e64cf68-a5f0-53b0-94d5-05c292bbbcea/1e64cf68-a5f0-53b0-94d5-05c292bbbcea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/c11dcd5a9d684d1aa607143430a0bb00/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980422%27 HTTP/1.1" 200 None
2026-03-24 22:54:17 [ayvens.be] INFO: Saving data for 1980422: {'created_time': 1774392857.585508, 'last_price_update_time': 1774392857.585518, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980422') HTTP/1.1" 204 0
2026-03-24 22:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/7.jpg not downloaded yet
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836bb90>
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/2.jpg saved to cache
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916f510>
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/1.jpg saved to cache
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382e90>
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/4.jpg saved to cache
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009642710>
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/5.jpg saved to cache
2026-03-24 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fab50>
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/3.jpg saved to cache
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009404f90>
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/7.jpg saved to cache
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/8.jpg not downloaded yet
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/9.jpg not downloaded yet
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ab350>
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/6.jpg saved to cache
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/10.jpg not downloaded yet
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a0d10>
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/1.jpg saved to cache
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009132990>
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/2.jpg saved to cache
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:18 [ayvens.be] INFO: Found listing with ID: 1980425
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980425%27 HTTP/1.1" 200 None
2026-03-24 22:54:18 [ayvens.be] INFO: Scrape type for 1980425: 1
2026-03-24 22:54:18 [ayvens.be] INFO: Extracting data for car ID: 1980425
2026-03-24 22:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1980425
2026-03-24 22:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f6b86a-64a3-5986-ae46-4ef20370de69 with scrape type 1
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/1.jpg not downloaded yet
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/2.jpg not downloaded yet
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1610>
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/3.jpg saved to cache
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/3.jpg not downloaded yet
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664d50>
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/8.jpg saved to cache
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/4.jpg not downloaded yet
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009771150>
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/9.jpg saved to cache
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/5.jpg not downloaded yet
2026-03-24 22:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/6.jpg not downloaded yet
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b5a50>
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F89c8c076507047cc8e61188175a6be04%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/10.jpg saved to cache
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09004bbc-6359-535b-a99e-b8b1fb675399
2026-03-24 22:54:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09004bbc-6359-535b-a99e-b8b1fb675399, skipping ID generation
2026-03-24 22:54:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09004bbc-6359-535b-a99e-b8b1fb675399 with scrape type 1
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09004bbc-6359-535b-a99e-b8b1fb675399 sending to next pipeline
2026-03-24 22:54:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09004bbc-6359-535b-a99e-b8b1fb675399, identifier: 1980423
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009789c10>
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/6.jpg saved to cache
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945b3d0>
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/4.jpg saved to cache
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772550>
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/7.jpg saved to cache
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008399f10>
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/5.jpg saved to cache
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009459010>
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/8.jpg saved to cache
2026-03-24 22:54:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1980423
2026-03-24 22:54:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1980423
2026-03-24 22:54:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1980423 to the API
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '09004bbc-6359-535b-a99e-b8b1fb675399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 111269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 900257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09004bbc-6359-535b-a99e-b8b1fb675399/09004bbc-6359-535b-a99e-b8b1fb675399_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/89c8c076507047cc8e61188175a6be04/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980423%27 HTTP/1.1" 200 None
2026-03-24 22:54:20 [ayvens.be] INFO: Saving data for 1980423: {'created_time': 1774392860.093627, 'last_price_update_time': 1774392860.093638, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980423') HTTP/1.1" 204 0
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/7.jpg not downloaded yet
2026-03-24 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945bf50>
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/9.jpg saved to cache
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971b290>
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fc434f00c3ecc42ca987dc432d0938f32%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/10.jpg saved to cache
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3
2026-03-24 22:54:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3, skipping ID generation
2026-03-24 22:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with scrape type 1
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 sending to next pipeline
2026-03-24 22:54:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3, identifier: 1980424
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/8.jpg not downloaded yet
2026-03-24 22:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1980424
2026-03-24 22:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1980424
2026-03-24 22:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1980424 to the API
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 180008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3/ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/c434f00c3ecc42ca987dc432d0938f32/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2020}
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980424%27 HTTP/1.1" 200 None
2026-03-24 22:54:20 [ayvens.be] INFO: Saving data for 1980424: {'created_time': 1774392860.687433, 'last_price_update_time': 1774392860.687442, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980424') HTTP/1.1" 204 0
2026-03-24 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/9.jpg not downloaded yet
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008373d50>
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/2.jpg saved to cache
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/10.jpg not downloaded yet
2026-03-24 22:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:20 [ayvens.be] INFO: Found listing with ID: 1980426
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980426%27 HTTP/1.1" 200 None
2026-03-24 22:54:20 [ayvens.be] INFO: Scrape type for 1980426: 1
2026-03-24 22:54:20 [ayvens.be] INFO: Extracting data for car ID: 1980426
2026-03-24 22:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1980426
2026-03-24 22:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ccbd74-4d59-5303-8962-b8d5e8bed838 with scrape type 1
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/1.jpg not downloaded yet
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083809d0>
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/1.jpg saved to cache
2026-03-24 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913ca10>
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/4.jpg saved to cache
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4d50>
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/3.jpg saved to cache
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/2.jpg not downloaded yet
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/3.jpg not downloaded yet
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008324b10>
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/5.jpg saved to cache
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/4.jpg not downloaded yet
2026-03-24 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/5.jpg not downloaded yet
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008370d10>
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/7.jpg saved to cache
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/6.jpg not downloaded yet
2026-03-24 22:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/7.jpg not downloaded yet
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009174e90>
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/6.jpg saved to cache
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b656e90>
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/8.jpg saved to cache
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/8.jpg not downloaded yet
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b77d0>
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/9.jpg saved to cache
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/9.jpg not downloaded yet
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685650>
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F35e0e234922a455ebb84398a197282df%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/10.jpg saved to cache
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10f6b86a-64a3-5986-ae46-4ef20370de69
2026-03-24 22:54:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10f6b86a-64a3-5986-ae46-4ef20370de69, skipping ID generation
2026-03-24 22:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f6b86a-64a3-5986-ae46-4ef20370de69 with scrape type 1
2026-03-24 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10f6b86a-64a3-5986-ae46-4ef20370de69 sending to next pipeline
2026-03-24 22:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 10f6b86a-64a3-5986-ae46-4ef20370de69, identifier: 1980425
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008371f10>
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/1.jpg saved to cache
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/10.jpg not downloaded yet
2026-03-24 22:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1980425
2026-03-24 22:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1980425
2026-03-24 22:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1980425 to the API
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '10f6b86a-64a3-5986-ae46-4ef20370de69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 89827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f6b86a-64a3-5986-ae46-4ef20370de69/10f6b86a-64a3-5986-ae46-4ef20370de69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/35e0e234922a455ebb84398a197282df/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.2 PURETECH 130 S-S SHINE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 S-S SHINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980425%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [ayvens.be] INFO: Saving data for 1980425: {'created_time': 1774392862.335255, 'last_price_update_time': 1774392862.335264, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980425') HTTP/1.1" 204 0
2026-03-24 22:54:22 [ayvens.be] INFO: Found listing with ID: 1980427
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980427%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [ayvens.be] INFO: Scrape type for 1980427: 1
2026-03-24 22:54:22 [ayvens.be] INFO: Extracting data for car ID: 1980427
2026-03-24 22:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1980427
2026-03-24 22:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1e7030-034b-5260-97c9-95ac6c87a369 with scrape type 1
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/1.jpg not downloaded yet
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/2.jpg not downloaded yet
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/3.jpg not downloaded yet
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/4.jpg not downloaded yet
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/5.jpg not downloaded yet
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/6.jpg not downloaded yet
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/7.jpg not downloaded yet
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/8.jpg not downloaded yet
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/9.jpg not downloaded yet
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a8210>
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/3.jpg saved to cache
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a0c10>
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/4.jpg saved to cache
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091af050>
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/2.jpg saved to cache
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838ebd0>
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/6.jpg saved to cache
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/10.jpg not downloaded yet
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008315590>
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/5.jpg saved to cache
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d00510>
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/7.jpg saved to cache
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:23 [ayvens.be] INFO: Found listing with ID: 1980428
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980428%27 HTTP/1.1" 200 None
2026-03-24 22:54:23 [ayvens.be] INFO: Scrape type for 1980428: 1
2026-03-24 22:54:23 [ayvens.be] INFO: Extracting data for car ID: 1980428
2026-03-24 22:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1980428
2026-03-24 22:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd347170-1c5d-5705-a41d-ca213afde7f0 with scrape type 1
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/1.jpg not downloaded yet
2026-03-24 22:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2d50>
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/8.jpg saved to cache
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c5e90>
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/1.jpg saved to cache
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a7950>
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/9.jpg saved to cache
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096409d0>
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/3.jpg saved to cache
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/2.jpg not downloaded yet
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/3.jpg not downloaded yet
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834dfd0>
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F2e1d983f8bb54ee88790ec5fdfd5857b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/10.jpg saved to cache
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3ccbd74-4d59-5303-8962-b8d5e8bed838
2026-03-24 22:54:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3ccbd74-4d59-5303-8962-b8d5e8bed838, skipping ID generation
2026-03-24 22:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ccbd74-4d59-5303-8962-b8d5e8bed838 with scrape type 1
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3ccbd74-4d59-5303-8962-b8d5e8bed838 sending to next pipeline
2026-03-24 22:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3ccbd74-4d59-5303-8962-b8d5e8bed838, identifier: 1980426
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422e90>
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/2.jpg saved to cache
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008383c90>
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/5.jpg saved to cache
2026-03-24 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1980426
2026-03-24 22:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1980426
2026-03-24 22:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1980426 to the API
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a3ccbd74-4d59-5303-8962-b8d5e8bed838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 52536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ccbd74-4d59-5303-8962-b8d5e8bed838/a3ccbd74-4d59-5303-8962-b8d5e8bed838_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/2e1d983f8bb54ee88790ec5fdfd5857b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 1.5 35 TFSI ADVANCED',
 'transmission': 'manual',
 'trim': '1.5 35 TFSI ADVANCED',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980426%27 HTTP/1.1" 200 None
2026-03-24 22:54:24 [ayvens.be] INFO: Saving data for 1980426: {'created_time': 1774392864.014633, 'last_price_update_time': 1774392864.014642, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980426') HTTP/1.1" 204 0
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/4.jpg not downloaded yet
2026-03-24 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3310>
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/6.jpg saved to cache
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fab90>
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/4.jpg saved to cache
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/5.jpg not downloaded yet
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971aa50>
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/7.jpg saved to cache
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/6.jpg not downloaded yet
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836a4d0>
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/8.jpg saved to cache
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/7.jpg not downloaded yet
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdb010>
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/9.jpg saved to cache
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/8.jpg not downloaded yet
2026-03-24 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/9.jpg not downloaded yet
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc64d0>
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F30f292eddcb848b9ad570eaca55a0aba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/10.jpg saved to cache
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d1e7030-034b-5260-97c9-95ac6c87a369
2026-03-24 22:54:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d1e7030-034b-5260-97c9-95ac6c87a369, skipping ID generation
2026-03-24 22:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1e7030-034b-5260-97c9-95ac6c87a369 with scrape type 1
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d1e7030-034b-5260-97c9-95ac6c87a369 sending to next pipeline
2026-03-24 22:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8d1e7030-034b-5260-97c9-95ac6c87a369, identifier: 1980427
2026-03-24 22:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1980427
2026-03-24 22:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1980427
2026-03-24 22:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1980427 to the API
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d1e7030-034b-5260-97c9-95ac6c87a369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 127584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1e7030-034b-5260-97c9-95ac6c87a369/8d1e7030-034b-5260-97c9-95ac6c87a369_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/30f292eddcb848b9ad570eaca55a0aba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM 2.0TD 130PS MHEV TREND FWD 340 LWB',
 'transmission': 'manual',
 'trim': '2.0TD 130PS MHEV TREND FWD 340 LWB',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980427%27 HTTP/1.1" 200 None
2026-03-24 22:54:24 [ayvens.be] INFO: Saving data for 1980427: {'created_time': 1774392864.957724, 'last_price_update_time': 1774392864.957733, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980427') HTTP/1.1" 204 0
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/10.jpg not downloaded yet
2026-03-24 22:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d5010>
2026-03-24 22:54:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/1.jpg saved to cache
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:25 [ayvens.be] INFO: Found listing with ID: 1980429
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980429%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [ayvens.be] INFO: Scrape type for 1980429: 1
2026-03-24 22:54:25 [ayvens.be] INFO: Extracting data for car ID: 1980429
2026-03-24 22:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1980429
2026-03-24 22:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137c0adf-7bc5-5006-8a80-389121a630c5 with scrape type 1
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/1.jpg not downloaded yet
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/2.jpg not downloaded yet
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441550>
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/2.jpg saved to cache
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/3.jpg not downloaded yet
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/4.jpg not downloaded yet
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/5.jpg not downloaded yet
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc4c90>
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/3.jpg saved to cache
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/6.jpg not downloaded yet
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a3390>
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/5.jpg saved to cache
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910f850>
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/4.jpg saved to cache
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963a3d0>
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/6.jpg saved to cache
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944a450>
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/7.jpg saved to cache
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/7.jpg not downloaded yet
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/8.jpg not downloaded yet
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/9.jpg not downloaded yet
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/10.jpg not downloaded yet
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [ayvens.be] INFO: Found listing with ID: 1980430
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980430%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [ayvens.be] INFO: Scrape type for 1980430: 1
2026-03-24 22:54:25 [ayvens.be] INFO: Extracting data for car ID: 1980430
2026-03-24 22:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1980430
2026-03-24 22:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c7920fc-e9bf-5130-8ddf-61283075c353 with scrape type 1
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/1.jpg not downloaded yet
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/2.jpg not downloaded yet
2026-03-24 22:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bab90>
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/10.jpg saved to cache
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1b90>
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/8.jpg saved to cache
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/3.jpg not downloaded yet
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/4.jpg not downloaded yet
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7510>
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/1.jpg saved to cache
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009686b10>
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fc1b0c4f982bf4c17adc4848785a1a775%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/9.jpg saved to cache
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd347170-1c5d-5705-a41d-ca213afde7f0
2026-03-24 22:54:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd347170-1c5d-5705-a41d-ca213afde7f0, skipping ID generation
2026-03-24 22:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd347170-1c5d-5705-a41d-ca213afde7f0 with scrape type 1
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd347170-1c5d-5705-a41d-ca213afde7f0 sending to next pipeline
2026-03-24 22:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd347170-1c5d-5705-a41d-ca213afde7f0, identifier: 1980428
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d00750>
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/2.jpg saved to cache
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345310>
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/3.jpg saved to cache
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083baed0>
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/4.jpg saved to cache
2026-03-24 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1980428
2026-03-24 22:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1980428
2026-03-24 22:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1980428 to the API
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bd347170-1c5d-5705-a41d-ca213afde7f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 48037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd347170-1c5d-5705-a41d-ca213afde7f0/bd347170-1c5d-5705-a41d-ca213afde7f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/c1b0c4f982bf4c17adc4848785a1a775/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980428%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [ayvens.be] INFO: Saving data for 1980428: {'created_time': 1774392867.054007, 'last_price_update_time': 1774392867.054017, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980428') HTTP/1.1" 204 0
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/5.jpg not downloaded yet
2026-03-24 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/6.jpg not downloaded yet
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/7.jpg not downloaded yet
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/8.jpg not downloaded yet
2026-03-24 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/9.jpg not downloaded yet
2026-03-24 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/10.jpg not downloaded yet
2026-03-24 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:27 [ayvens.be] INFO: Found listing with ID: 1980431
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980431%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [ayvens.be] INFO: Scrape type for 1980431: 1
2026-03-24 22:54:27 [ayvens.be] INFO: Extracting data for car ID: 1980431
2026-03-24 22:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1980431
2026-03-24 22:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with scrape type 1
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/1.jpg not downloaded yet
2026-03-24 22:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d4d0>
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/6.jpg saved to cache
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915c4d0>
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/5.jpg saved to cache
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/2.jpg not downloaded yet
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/3.jpg not downloaded yet
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/4.jpg not downloaded yet
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910e4d0>
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/8.jpg saved to cache
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f9d0>
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/7.jpg saved to cache
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a2610>
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/10.jpg saved to cache
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096655d0>
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F4276a00960e8495cb55dfd5d028461af%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/9.jpg saved to cache
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 137c0adf-7bc5-5006-8a80-389121a630c5
2026-03-24 22:54:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 137c0adf-7bc5-5006-8a80-389121a630c5, skipping ID generation
2026-03-24 22:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137c0adf-7bc5-5006-8a80-389121a630c5 with scrape type 1
2026-03-24 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 137c0adf-7bc5-5006-8a80-389121a630c5 sending to next pipeline
2026-03-24 22:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 137c0adf-7bc5-5006-8a80-389121a630c5, identifier: 1980429
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae550>
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/2.jpg saved to cache
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009190f10>
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/1.jpg saved to cache
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1980429
2026-03-24 22:54:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1980429
2026-03-24 22:54:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1980429 to the API
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '137c0adf-7bc5-5006-8a80-389121a630c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 29940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 889217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c0adf-7bc5-5006-8a80-389121a630c5/137c0adf-7bc5-5006-8a80-389121a630c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/4276a00960e8495cb55dfd5d028461af/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980429%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [ayvens.be] INFO: Saving data for 1980429: {'created_time': 1774392868.640812, 'last_price_update_time': 1774392868.640821, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980429') HTTP/1.1" 204 0
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/5.jpg not downloaded yet
2026-03-24 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/6.jpg not downloaded yet
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/7.jpg not downloaded yet
2026-03-24 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/8.jpg not downloaded yet
2026-03-24 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/9.jpg not downloaded yet
2026-03-24 22:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/10.jpg not downloaded yet
2026-03-24 22:54:28 [ayvens.be] INFO: Found listing with ID: 1980432
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980432%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [ayvens.be] INFO: Scrape type for 1980432: 1
2026-03-24 22:54:28 [ayvens.be] INFO: Extracting data for car ID: 1980432
2026-03-24 22:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1980432
2026-03-24 22:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with scrape type 1
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/1.jpg not downloaded yet
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/2.jpg not downloaded yet
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962e1d0>
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/4.jpg saved to cache
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/3.jpg not downloaded yet
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309710>
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/5.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009174d50>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/7.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d00a10>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/3.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/4.jpg not downloaded yet
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/5.jpg not downloaded yet
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a3210>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/6.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442750>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/8.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009566490>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/9.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/6.jpg not downloaded yet
2026-03-24 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/7.jpg not downloaded yet
2026-03-24 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/8.jpg not downloaded yet
2026-03-24 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/9.jpg not downloaded yet
2026-03-24 22:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/10.jpg not downloaded yet
2026-03-24 22:54:29 [ayvens.be] INFO: Found listing with ID: 1980433
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980433%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [ayvens.be] INFO: Scrape type for 1980433: 1
2026-03-24 22:54:29 [ayvens.be] INFO: Extracting data for car ID: 1980433
2026-03-24 22:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1980433
2026-03-24 22:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b083bf-6e40-5b10-aa61-972197b7bf06 with scrape type 1
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/1.jpg not downloaded yet
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c5a50>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/4.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/2.jpg not downloaded yet
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d03750>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/1.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334d50>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/3.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e390>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/7.jpg saved to cache
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009565750>
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/2.jpg saved to cache
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911fbd0>
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/6.jpg saved to cache
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/3.jpg not downloaded yet
2026-03-24 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/4.jpg not downloaded yet
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a5d50>
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/5.jpg saved to cache
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc4550>
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Faa3426ffb1db4ba58f5e3001ab914993%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/10.jpg saved to cache
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c7920fc-e9bf-5130-8ddf-61283075c353
2026-03-24 22:54:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c7920fc-e9bf-5130-8ddf-61283075c353, skipping ID generation
2026-03-24 22:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c7920fc-e9bf-5130-8ddf-61283075c353 with scrape type 1
2026-03-24 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c7920fc-e9bf-5130-8ddf-61283075c353 sending to next pipeline
2026-03-24 22:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5c7920fc-e9bf-5130-8ddf-61283075c353, identifier: 1980430
2026-03-24 22:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1980430
2026-03-24 22:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1980430
2026-03-24 22:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1980430 to the API
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '5c7920fc-e9bf-5130-8ddf-61283075c353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 145068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 855817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 859367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 873915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c7920fc-e9bf-5130-8ddf-61283075c353/5c7920fc-e9bf-5130-8ddf-61283075c353_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/aa3426ffb1db4ba58f5e3001ab914993/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980430%27 HTTP/1.1" 200 None
2026-03-24 22:54:30 [ayvens.be] INFO: Saving data for 1980430: {'created_time': 1774392870.974108, 'last_price_update_time': 1774392870.974119, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980430') HTTP/1.1" 204 0
2026-03-24 22:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/5.jpg not downloaded yet
2026-03-24 22:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/6.jpg not downloaded yet
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839a250>
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/10.jpg saved to cache
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b83d0>
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/2.jpg saved to cache
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/7.jpg not downloaded yet
2026-03-24 22:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/8.jpg not downloaded yet
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bfbe310>
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/3.jpg saved to cache
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d5e50>
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/4.jpg saved to cache
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009190d50>
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/1.jpg saved to cache
2026-03-24 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/9.jpg not downloaded yet
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/10.jpg not downloaded yet
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093dafd0>
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/8.jpg saved to cache
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913ff10>
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F20371d54219f48c7864471bc83c072cb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/9.jpg saved to cache
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467
2026-03-24 22:54:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467, skipping ID generation
2026-03-24 22:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with scrape type 1
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 sending to next pipeline
2026-03-24 22:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467, identifier: 1980431
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914f210>
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/5.jpg saved to cache
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:32 [ayvens.be] INFO: Found listing with ID: 1980434
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980434%27 HTTP/1.1" 200 None
2026-03-24 22:54:32 [ayvens.be] INFO: Scrape type for 1980434: 1
2026-03-24 22:54:32 [ayvens.be] INFO: Extracting data for car ID: 1980434
2026-03-24 22:54:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1980434
2026-03-24 22:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b96f03-39fa-5bd4-85b8-d927562d4040 with scrape type 1
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/1.jpg not downloaded yet
2026-03-24 22:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1980431
2026-03-24 22:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1980431
2026-03-24 22:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1980431 to the API
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 169483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467/8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/20371d54219f48c7864471bc83c072cb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980431%27 HTTP/1.1" 200 None
2026-03-24 22:54:32 [ayvens.be] INFO: Saving data for 1980431: {'created_time': 1774392872.805399, 'last_price_update_time': 1774392872.805413, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980431') HTTP/1.1" 204 0
2026-03-24 22:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/2.jpg not downloaded yet
2026-03-24 22:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/3.jpg not downloaded yet
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914edd0>
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/2.jpg saved to cache
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094904d0>
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/1.jpg saved to cache
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/4.jpg not downloaded yet
2026-03-24 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/5.jpg not downloaded yet
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ec610>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/6.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c8a10>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/7.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bb490>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/10.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009448390>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/4.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372590>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/3.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/6.jpg not downloaded yet
2026-03-24 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/7.jpg not downloaded yet
2026-03-24 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/8.jpg not downloaded yet
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b9dd0>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/5.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/9.jpg not downloaded yet
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/10.jpg not downloaded yet
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a0210>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/9.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae6d0>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/6.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666310>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/7.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911d350>
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbc06ed55be0448a1a4a9ef75831c3bd3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/8.jpg saved to cache
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c
2026-03-24 22:54:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c, skipping ID generation
2026-03-24 22:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with scrape type 1
2026-03-24 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c sending to next pipeline
2026-03-24 22:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c, identifier: 1980432
2026-03-24 22:54:33 [ayvens.be] INFO: Found listing with ID: 1980435
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980435%27 HTTP/1.1" 200 None
2026-03-24 22:54:34 [ayvens.be] INFO: Scrape type for 1980435: 1
2026-03-24 22:54:34 [ayvens.be] INFO: Extracting data for car ID: 1980435
2026-03-24 22:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1980435
2026-03-24 22:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 585391de-3103-5b60-94d9-9311ab472214 with scrape type 1
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/1.jpg not downloaded yet
2026-03-24 22:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1980432
2026-03-24 22:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1980432
2026-03-24 22:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1980432 to the API
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4f9c68b3-6983-5ac0-8bcd-39735c55a15c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 105953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f9c68b3-6983-5ac0-8bcd-39735c55a15c/4f9c68b3-6983-5ac0-8bcd-39735c55a15c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bc06ed55be0448a1a4a9ef75831c3bd3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 CLEVER',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980432%27 HTTP/1.1" 200 None
2026-03-24 22:54:34 [ayvens.be] INFO: Saving data for 1980432: {'created_time': 1774392874.327053, 'last_price_update_time': 1774392874.327063, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980432') HTTP/1.1" 204 0
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/2.jpg not downloaded yet
2026-03-24 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/3.jpg not downloaded yet
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e03d0>
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/8.jpg saved to cache
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e3710>
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/9.jpg saved to cache
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d9410>
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Ffc619304b8354e559d42cb55f9f35b1d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/10.jpg saved to cache
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0b083bf-6e40-5b10-aa61-972197b7bf06
2026-03-24 22:54:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0b083bf-6e40-5b10-aa61-972197b7bf06, skipping ID generation
2026-03-24 22:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b083bf-6e40-5b10-aa61-972197b7bf06 with scrape type 1
2026-03-24 22:54:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0b083bf-6e40-5b10-aa61-972197b7bf06 sending to next pipeline
2026-03-24 22:54:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0b083bf-6e40-5b10-aa61-972197b7bf06, identifier: 1980433
2026-03-24 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1980433
2026-03-24 22:54:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1980433
2026-03-24 22:54:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1980433 to the API
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd0b083bf-6e40-5b10-aa61-972197b7bf06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 188787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0b083bf-6e40-5b10-aa61-972197b7bf06/d0b083bf-6e40-5b10-aa61-972197b7bf06_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/fc619304b8354e559d42cb55f9f35b1d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 2.0 B 200 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 B 200 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980433%27 HTTP/1.1" 200 None
2026-03-24 22:54:35 [ayvens.be] INFO: Saving data for 1980433: {'created_time': 1774392875.102641, 'last_price_update_time': 1774392875.10265, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980433') HTTP/1.1" 204 0
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/4.jpg not downloaded yet
2026-03-24 22:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/5.jpg not downloaded yet
2026-03-24 22:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f9d0>
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/1.jpg saved to cache
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e410>
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/3.jpg saved to cache
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f8e50>
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/6.jpg saved to cache
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/6.jpg not downloaded yet
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/7.jpg not downloaded yet
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d90d0>
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/8.jpg saved to cache
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091754d0>
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/4.jpg saved to cache
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910cd50>
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/7.jpg saved to cache
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008359490>
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/2.jpg saved to cache
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/8.jpg not downloaded yet
2026-03-24 22:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aecfc10>
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/5.jpg saved to cache
2026-03-24 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/9.jpg not downloaded yet
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/10.jpg not downloaded yet
2026-03-24 22:54:36 [ayvens.be] INFO: Found listing with ID: 1980436
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980436%27 HTTP/1.1" 200 None
2026-03-24 22:54:36 [ayvens.be] INFO: Scrape type for 1980436: 1
2026-03-24 22:54:36 [ayvens.be] INFO: Extracting data for car ID: 1980436
2026-03-24 22:54:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1980436
2026-03-24 22:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a020241f-9671-558c-b1cb-37c2c25a38ed with scrape type 1
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/1.jpg not downloaded yet
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6cee10>
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/9.jpg saved to cache
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/2.jpg not downloaded yet
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910c750>
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fdeb3915246114d5fb5f6f116469ff436%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/10.jpg saved to cache
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20b96f03-39fa-5bd4-85b8-d927562d4040
2026-03-24 22:54:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20b96f03-39fa-5bd4-85b8-d927562d4040, skipping ID generation
2026-03-24 22:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b96f03-39fa-5bd4-85b8-d927562d4040 with scrape type 1
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20b96f03-39fa-5bd4-85b8-d927562d4040 sending to next pipeline
2026-03-24 22:54:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 20b96f03-39fa-5bd4-85b8-d927562d4040, identifier: 1980434
2026-03-24 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/3.jpg not downloaded yet
2026-03-24 22:54:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1980434
2026-03-24 22:54:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1980434
2026-03-24 22:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1980434 to the API
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '20b96f03-39fa-5bd4-85b8-d927562d4040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 91807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20b96f03-39fa-5bd4-85b8-d927562d4040/20b96f03-39fa-5bd4-85b8-d927562d4040_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/deb3915246114d5fb5f6f116469ff436/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.0 30 TFSI 81KW',
 'transmission': 'manual',
 'trim': '1.0 30 TFSI 81KW',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980434%27 HTTP/1.1" 200 None
2026-03-24 22:54:36 [ayvens.be] INFO: Saving data for 1980434: {'created_time': 1774392876.744902, 'last_price_update_time': 1774392876.744912, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980434') HTTP/1.1" 204 0
2026-03-24 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/4.jpg not downloaded yet
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8390>
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/1.jpg saved to cache
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aba50>
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/2.jpg saved to cache
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/5.jpg not downloaded yet
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a3450>
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/3.jpg saved to cache
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343a10>
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/4.jpg saved to cache
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967d510>
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/5.jpg saved to cache
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/6.jpg not downloaded yet
2026-03-24 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/7.jpg not downloaded yet
2026-03-24 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/8.jpg not downloaded yet
2026-03-24 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/9.jpg not downloaded yet
2026-03-24 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/10.jpg not downloaded yet
2026-03-24 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:37 [ayvens.be] INFO: Found listing with ID: 1980437
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980437%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [ayvens.be] INFO: Scrape type for 1980437: 1
2026-03-24 22:54:37 [ayvens.be] INFO: Extracting data for car ID: 1980437
2026-03-24 22:54:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1980437
2026-03-24 22:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 with scrape type 1
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/1.jpg not downloaded yet
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/2.jpg not downloaded yet
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b27d590>
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/7.jpg saved to cache
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/3.jpg not downloaded yet
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f490>
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/8.jpg saved to cache
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009466090>
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/6.jpg saved to cache
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/4.jpg not downloaded yet
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938c6d0>
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/1.jpg saved to cache
2026-03-24 22:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c9190>
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/10.jpg saved to cache
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975b550>
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Ff719d059c44a4cc48ae62eb6978ae78a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/9.jpg saved to cache
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 585391de-3103-5b60-94d9-9311ab472214
2026-03-24 22:54:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 585391de-3103-5b60-94d9-9311ab472214, skipping ID generation
2026-03-24 22:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 585391de-3103-5b60-94d9-9311ab472214 with scrape type 1
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 585391de-3103-5b60-94d9-9311ab472214 sending to next pipeline
2026-03-24 22:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 585391de-3103-5b60-94d9-9311ab472214, identifier: 1980435
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00ca668d0>
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/2.jpg saved to cache
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009942490>
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/3.jpg saved to cache
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/5.jpg not downloaded yet
2026-03-24 22:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1980435
2026-03-24 22:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1980435
2026-03-24 22:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1980435 to the API
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'PHYTONICBLAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '585391de-3103-5b60-94d9-9311ab472214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 114666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 849702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_585391de-3103-5b60-94d9-9311ab472214/585391de-3103-5b60-94d9-9311ab472214_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/f719d059c44a4cc48ae62eb6978ae78a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980435%27 HTTP/1.1" 200 None
2026-03-24 22:54:38 [ayvens.be] INFO: Saving data for 1980435: {'created_time': 1774392878.780191, 'last_price_update_time': 1774392878.780206, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980435') HTTP/1.1" 204 0
2026-03-24 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/6.jpg not downloaded yet
2026-03-24 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d00c10>
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/4.jpg saved to cache
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/7.jpg not downloaded yet
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/8.jpg not downloaded yet
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009687cd0>
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/5.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/9.jpg not downloaded yet
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce910>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/7.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/10.jpg not downloaded yet
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009420d90>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/8.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009642a50>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/6.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3950>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/1.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:39 [ayvens.be] INFO: Found listing with ID: 1980438
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980438%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [ayvens.be] INFO: Scrape type for 1980438: 1
2026-03-24 22:54:39 [ayvens.be] INFO: Extracting data for car ID: 1980438
2026-03-24 22:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1980438
2026-03-24 22:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065560d5-73ef-5e5a-8e8e-13da0a591f77 with scrape type 1
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/1.jpg not downloaded yet
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/2.jpg not downloaded yet
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cfd90>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/4.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cc5d0>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/3.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091441d0>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/2.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/3.jpg not downloaded yet
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/4.jpg not downloaded yet
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/5.jpg not downloaded yet
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/6.jpg not downloaded yet
2026-03-24 22:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/7.jpg not downloaded yet
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/8.jpg not downloaded yet
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/9.jpg not downloaded yet
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083586d0>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/10.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760d10>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/7.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c2dd0>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/5.jpg saved to cache
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/10.jpg not downloaded yet
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d29d0>
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1aedc2fa2cd84489a031cb738de8a733%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/9.jpg saved to cache
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a020241f-9671-558c-b1cb-37c2c25a38ed
2026-03-24 22:54:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a020241f-9671-558c-b1cb-37c2c25a38ed, skipping ID generation
2026-03-24 22:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a020241f-9671-558c-b1cb-37c2c25a38ed with scrape type 1
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a020241f-9671-558c-b1cb-37c2c25a38ed sending to next pipeline
2026-03-24 22:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a020241f-9671-558c-b1cb-37c2c25a38ed, identifier: 1980436
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94bd0>
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/6.jpg saved to cache
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:40 [ayvens.be] INFO: Found listing with ID: 1980439
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980439%27 HTTP/1.1" 200 None
2026-03-24 22:54:40 [ayvens.be] INFO: Scrape type for 1980439: 1
2026-03-24 22:54:40 [ayvens.be] INFO: Extracting data for car ID: 1980439
2026-03-24 22:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1980439
2026-03-24 22:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70e0a53-f615-5e36-8282-b789dd1802c1 with scrape type 1
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/1.jpg not downloaded yet
2026-03-24 22:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1980436
2026-03-24 22:54:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1980436
2026-03-24 22:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1980436 to the API
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'STD',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a020241f-9671-558c-b1cb-37c2c25a38ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'MIRAI',
 'odometer': 31331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a020241f-9671-558c-b1cb-37c2c25a38ed/a020241f-9671-558c-b1cb-37c2c25a38ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1aedc2fa2cd84489a031cb738de8a733/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA MIRAI Mirai Fuel Cell',
 'transmission': 'automatic',
 'trim': 'Mirai Fuel Cell',
 'vin': None,
 'year': 2020}
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980436%27 HTTP/1.1" 200 None
2026-03-24 22:54:40 [ayvens.be] INFO: Saving data for 1980436: {'created_time': 1774392880.657454, 'last_price_update_time': 1774392880.657462, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980436') HTTP/1.1" 204 0
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/2.jpg not downloaded yet
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009186950>
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/10.jpg saved to cache
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009174910>
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/8.jpg saved to cache
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ed9d0>
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F973ebb995e5941269916b22b994c089a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/9.jpg saved to cache
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd5e129c-9014-5e1f-8926-20ca8a02deb0
2026-03-24 22:54:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd5e129c-9014-5e1f-8926-20ca8a02deb0, skipping ID generation
2026-03-24 22:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 with scrape type 1
2026-03-24 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 sending to next pipeline
2026-03-24 22:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd5e129c-9014-5e1f-8926-20ca8a02deb0, identifier: 1980437
2026-03-24 22:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1980437
2026-03-24 22:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1980437
2026-03-24 22:54:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1980437 to the API
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bd5e129c-9014-5e1f-8926-20ca8a02deb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 187410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd5e129c-9014-5e1f-8926-20ca8a02deb0/bd5e129c-9014-5e1f-8926-20ca8a02deb0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/973ebb995e5941269916b22b994c089a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV CORE DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV CORE DCT',
 'vin': None,
 'year': 2023}
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980437%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [ayvens.be] INFO: Saving data for 1980437: {'created_time': 1774392881.372848, 'last_price_update_time': 1774392881.372859, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980437') HTTP/1.1" 204 0
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/3.jpg not downloaded yet
2026-03-24 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/4.jpg not downloaded yet
2026-03-24 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/5.jpg not downloaded yet
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/6.jpg not downloaded yet
2026-03-24 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/7.jpg not downloaded yet
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/8.jpg not downloaded yet
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/9.jpg not downloaded yet
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/10.jpg not downloaded yet
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e8d0>
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/2.jpg saved to cache
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:41 [ayvens.be] INFO: Found listing with ID: 1980440
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980440%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [ayvens.be] INFO: Scrape type for 1980440: 1
2026-03-24 22:54:41 [ayvens.be] INFO: Extracting data for car ID: 1980440
2026-03-24 22:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1980440
2026-03-24 22:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 with scrape type 1
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/1.jpg not downloaded yet
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f80d0>
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/1.jpg saved to cache
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144410>
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/4.jpg saved to cache
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970c610>
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/7.jpg saved to cache
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/2.jpg not downloaded yet
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975b990>
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/5.jpg saved to cache
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae650>
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/3.jpg saved to cache
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce4d0>
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/6.jpg saved to cache
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8250>
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/8.jpg saved to cache
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/3.jpg not downloaded yet
2026-03-24 22:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/4.jpg not downloaded yet
2026-03-24 22:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/5.jpg not downloaded yet
2026-03-24 22:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/6.jpg not downloaded yet
2026-03-24 22:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/7.jpg not downloaded yet
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/8.jpg not downloaded yet
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/9.jpg not downloaded yet
2026-03-24 22:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/10.jpg not downloaded yet
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ad990>
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/9.jpg saved to cache
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:42 [ayvens.be] INFO: Found listing with ID: 1980441
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980441%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [ayvens.be] INFO: Scrape type for 1980441: 1
2026-03-24 22:54:42 [ayvens.be] INFO: Extracting data for car ID: 1980441
2026-03-24 22:54:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0d07666-6771-5589-95ce-953971248d4a with identifier: 1980441
2026-03-24 22:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d07666-6771-5589-95ce-953971248d4a with scrape type 1
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/1.jpg not downloaded yet
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c650>
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fa8ea87027d2c4df2ab1708564ef89020%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/10.jpg saved to cache
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 065560d5-73ef-5e5a-8e8e-13da0a591f77
2026-03-24 22:54:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 065560d5-73ef-5e5a-8e8e-13da0a591f77, skipping ID generation
2026-03-24 22:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065560d5-73ef-5e5a-8e8e-13da0a591f77 with scrape type 1
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 065560d5-73ef-5e5a-8e8e-13da0a591f77 sending to next pipeline
2026-03-24 22:54:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 065560d5-73ef-5e5a-8e8e-13da0a591f77, identifier: 1980438
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/2.jpg not downloaded yet
2026-03-24 22:54:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1980438
2026-03-24 22:54:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1980438
2026-03-24 22:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1980438 to the API
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '065560d5-73ef-5e5a-8e8e-13da0a591f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 78233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 848305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065560d5-73ef-5e5a-8e8e-13da0a591f77/065560d5-73ef-5e5a-8e8e-13da0a591f77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/a8ea87027d2c4df2ab1708564ef89020/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO BUSINESS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO BUSINESS SOL AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980438%27 HTTP/1.1" 200 None
2026-03-24 22:54:43 [ayvens.be] INFO: Saving data for 1980438: {'created_time': 1774392883.063762, 'last_price_update_time': 1774392883.063775, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980438') HTTP/1.1" 204 0
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/3.jpg not downloaded yet
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a2f10>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/1.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aaa50>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/2.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309250>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/3.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834cf50>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/4.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d2d0>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/1.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/4.jpg not downloaded yet
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/5.jpg not downloaded yet
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02350>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/3.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/6.jpg not downloaded yet
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/7.jpg not downloaded yet
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/8.jpg not downloaded yet
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083710d0>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/2.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/9.jpg not downloaded yet
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a7990>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/10.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c5b50>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/7.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/10.jpg not downloaded yet
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b297310>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/9.jpg saved to cache
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338e10>
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/6.jpg saved to cache
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4d50>
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/5.jpg saved to cache
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967f210>
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/4.jpg saved to cache
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967cd50>
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252Fa242f160b0ae480c805b563bd021d5f3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/8.jpg saved to cache
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e70e0a53-f615-5e36-8282-b789dd1802c1
2026-03-24 22:54:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e70e0a53-f615-5e36-8282-b789dd1802c1, skipping ID generation
2026-03-24 22:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70e0a53-f615-5e36-8282-b789dd1802c1 with scrape type 1
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e70e0a53-f615-5e36-8282-b789dd1802c1 sending to next pipeline
2026-03-24 22:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e70e0a53-f615-5e36-8282-b789dd1802c1, identifier: 1980439
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009147550>
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/5.jpg saved to cache
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:44 [ayvens.be] INFO: Found listing with ID: 1980442
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980442%27 HTTP/1.1" 200 None
2026-03-24 22:54:44 [ayvens.be] INFO: Scrape type for 1980442: 1
2026-03-24 22:54:44 [ayvens.be] INFO: Extracting data for car ID: 1980442
2026-03-24 22:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1980442
2026-03-24 22:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 053c27bf-20c6-52f1-897d-b564c8a68ac2 with scrape type 1
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/1.jpg not downloaded yet
2026-03-24 22:54:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1980439
2026-03-24 22:54:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1980439
2026-03-24 22:54:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1980439 to the API
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e70e0a53-f615-5e36-8282-b789dd1802c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 71679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70e0a53-f615-5e36-8282-b789dd1802c1/e70e0a53-f615-5e36-8282-b789dd1802c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/a242f160b0ae480c805b563bd021d5f3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980439%27 HTTP/1.1" 200 None
2026-03-24 22:54:44 [ayvens.be] INFO: Saving data for 1980439: {'created_time': 1774392884.722354, 'last_price_update_time': 1774392884.722366, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980439') HTTP/1.1" 204 0
2026-03-24 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/2.jpg not downloaded yet
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1ba910>
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/6.jpg saved to cache
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959e990>
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/7.jpg saved to cache
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/3.jpg not downloaded yet
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009111c10>
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/8.jpg saved to cache
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/4.jpg not downloaded yet
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347cd0>
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/9.jpg saved to cache
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091129d0>
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/2.jpg saved to cache
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492c90>
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3d563a139d2f485fa83e8b2a9b140cbc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/10.jpg saved to cache
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9474db12-7db3-5b4b-b87e-d1af39983ce6
2026-03-24 22:54:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9474db12-7db3-5b4b-b87e-d1af39983ce6, skipping ID generation
2026-03-24 22:54:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 with scrape type 1
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 sending to next pipeline
2026-03-24 22:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9474db12-7db3-5b4b-b87e-d1af39983ce6, identifier: 1980440
2026-03-24 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/5.jpg not downloaded yet
2026-03-24 22:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1980440
2026-03-24 22:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1980440
2026-03-24 22:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1980440 to the API
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '9474db12-7db3-5b4b-b87e-d1af39983ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 164062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474db12-7db3-5b4b-b87e-d1af39983ce6/9474db12-7db3-5b4b-b87e-d1af39983ce6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3d563a139d2f485fa83e8b2a9b140cbc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980440%27 HTTP/1.1" 200 None
2026-03-24 22:54:45 [ayvens.be] INFO: Saving data for 1980440: {'created_time': 1774392885.650531, 'last_price_update_time': 1774392885.650541, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980440') HTTP/1.1" 204 0
2026-03-24 22:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/6.jpg not downloaded yet
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911cd90>
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/1.jpg saved to cache
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/7.jpg not downloaded yet
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b7ed0>
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/3.jpg saved to cache
2026-03-24 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ab190>
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/4.jpg saved to cache
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/8.jpg not downloaded yet
2026-03-24 22:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c1d0>
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/5.jpg saved to cache
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/9.jpg not downloaded yet
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/10.jpg not downloaded yet
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb2d0>
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/6.jpg saved to cache
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:46 [ayvens.be] INFO: Found listing with ID: 1980443
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980443%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [ayvens.be] INFO: Scrape type for 1980443: 1
2026-03-24 22:54:46 [ayvens.be] INFO: Extracting data for car ID: 1980443
2026-03-24 22:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1980443
2026-03-24 22:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b02a049f-23ad-52f2-a198-bcbf99a914dd with scrape type 1
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/1.jpg not downloaded yet
2026-03-24 22:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/2.jpg not downloaded yet
2026-03-24 22:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/3.jpg not downloaded yet
2026-03-24 22:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/4.jpg not downloaded yet
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/5.jpg not downloaded yet
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a1010>
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/7.jpg saved to cache
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008344cd0>
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/9.jpg saved to cache
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/6.jpg not downloaded yet
2026-03-24 22:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/7.jpg not downloaded yet
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/8.jpg not downloaded yet
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009012c50>
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/10.jpg saved to cache
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bfa50>
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F38090b50e3524da4831aeeec1f803b7b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/8.jpg saved to cache
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0d07666-6771-5589-95ce-953971248d4a
2026-03-24 22:54:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0d07666-6771-5589-95ce-953971248d4a, skipping ID generation
2026-03-24 22:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d07666-6771-5589-95ce-953971248d4a with scrape type 1
2026-03-24 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0d07666-6771-5589-95ce-953971248d4a sending to next pipeline
2026-03-24 22:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0d07666-6771-5589-95ce-953971248d4a, identifier: 1980441
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b547410>
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/2.jpg saved to cache
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009614f90>
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/3.jpg saved to cache
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962e4d0>
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/1.jpg saved to cache
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0d07666-6771-5589-95ce-953971248d4a with identifier: 1980441
2026-03-24 22:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0d07666-6771-5589-95ce-953971248d4a with identifier: 1980441
2026-03-24 22:54:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0d07666-6771-5589-95ce-953971248d4a with identifier: 1980441 to the API
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd0d07666-6771-5589-95ce-953971248d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 93800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 955866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 837412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0d07666-6771-5589-95ce-953971248d4a/d0d07666-6771-5589-95ce-953971248d4a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/38090b50e3524da4831aeeec1f803b7b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980441%27 HTTP/1.1" 200 None
2026-03-24 22:54:47 [ayvens.be] INFO: Saving data for 1980441: {'created_time': 1774392887.576599, 'last_price_update_time': 1774392887.576608, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980441') HTTP/1.1" 204 0
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/9.jpg not downloaded yet
2026-03-24 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/10.jpg not downloaded yet
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970f910>
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/4.jpg saved to cache
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:47 [ayvens.be] INFO: Found listing with ID: 1980444
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980444%27 HTTP/1.1" 200 None
2026-03-24 22:54:47 [ayvens.be] INFO: Scrape type for 1980444: 1
2026-03-24 22:54:47 [ayvens.be] INFO: Extracting data for car ID: 1980444
2026-03-24 22:54:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1980444
2026-03-24 22:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7d428a-e542-54a6-9d6b-4241d510c1db with scrape type 1
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/1.jpg not downloaded yet
2026-03-24 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/2.jpg not downloaded yet
2026-03-24 22:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/3.jpg not downloaded yet
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e6d0>
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/5.jpg saved to cache
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/4.jpg not downloaded yet
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/5.jpg not downloaded yet
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334fd0>
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/6.jpg saved to cache
2026-03-24 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a4250>
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/1.jpg saved to cache
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091324d0>
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/9.jpg saved to cache
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a6390>
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/10.jpg saved to cache
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bf6d0>
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/7.jpg saved to cache
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd650>
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F09dfe84ebd034662904a9ff67032ffa9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/8.jpg saved to cache
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 053c27bf-20c6-52f1-897d-b564c8a68ac2
2026-03-24 22:54:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 053c27bf-20c6-52f1-897d-b564c8a68ac2, skipping ID generation
2026-03-24 22:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 053c27bf-20c6-52f1-897d-b564c8a68ac2 with scrape type 1
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 053c27bf-20c6-52f1-897d-b564c8a68ac2 sending to next pipeline
2026-03-24 22:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 053c27bf-20c6-52f1-897d-b564c8a68ac2, identifier: 1980442
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/6.jpg not downloaded yet
2026-03-24 22:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1980442
2026-03-24 22:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1980442
2026-03-24 22:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1980442 to the API
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '053c27bf-20c6-52f1-897d-b564c8a68ac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 33578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_053c27bf-20c6-52f1-897d-b564c8a68ac2/053c27bf-20c6-52f1-897d-b564c8a68ac2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/09dfe84ebd034662904a9ff67032ffa9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980442%27 HTTP/1.1" 200 None
2026-03-24 22:54:48 [ayvens.be] INFO: Saving data for 1980442: {'created_time': 1774392888.82477, 'last_price_update_time': 1774392888.824782, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980442') HTTP/1.1" 204 0
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/7.jpg not downloaded yet
2026-03-24 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/8.jpg not downloaded yet
2026-03-24 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/9.jpg not downloaded yet
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/10.jpg not downloaded yet
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [ayvens.be] INFO: Found listing with ID: 1980445
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980445%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [ayvens.be] INFO: Scrape type for 1980445: 1
2026-03-24 22:54:49 [ayvens.be] INFO: Extracting data for car ID: 1980445
2026-03-24 22:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1980445
2026-03-24 22:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b27291-52b1-5bb8-8777-db035e76e519 with scrape type 1
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/1.jpg not downloaded yet
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/2.jpg not downloaded yet
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009839490>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/7.jpg saved to cache
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008326790>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/8.jpg saved to cache
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009758890>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/5.jpg saved to cache
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/3.jpg not downloaded yet
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab450>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/6.jpg saved to cache
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009770f50>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/4.jpg saved to cache
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/4.jpg not downloaded yet
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/5.jpg not downloaded yet
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d49d0>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/2.jpg saved to cache
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009132810>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/9.jpg saved to cache
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839b1d0>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/3.jpg saved to cache
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/6.jpg not downloaded yet
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/7.jpg not downloaded yet
2026-03-24 22:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b297fd0>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/1.jpg saved to cache
2026-03-24 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405b50>
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/2.jpg saved to cache
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093da110>
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/7.jpg saved to cache
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/8.jpg not downloaded yet
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/9.jpg not downloaded yet
2026-03-24 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/10.jpg not downloaded yet
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406710>
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/6.jpg saved to cache
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009861b50>
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/5.jpg saved to cache
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a2350>
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/4.jpg saved to cache
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b210>
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/3.jpg saved to cache
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b5e90>
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F754dbf4a08b548fa98db39cd7203e537%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/10.jpg saved to cache
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b02a049f-23ad-52f2-a198-bcbf99a914dd
2026-03-24 22:54:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b02a049f-23ad-52f2-a198-bcbf99a914dd, skipping ID generation
2026-03-24 22:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b02a049f-23ad-52f2-a198-bcbf99a914dd with scrape type 1
2026-03-24 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b02a049f-23ad-52f2-a198-bcbf99a914dd sending to next pipeline
2026-03-24 22:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b02a049f-23ad-52f2-a198-bcbf99a914dd, identifier: 1980443
2026-03-24 22:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1980443
2026-03-24 22:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1980443
2026-03-24 22:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1980443 to the API
2026-03-24 22:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b02a049f-23ad-52f2-a198-bcbf99a914dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 116175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b02a049f-23ad-52f2-a198-bcbf99a914dd/b02a049f-23ad-52f2-a198-bcbf99a914dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/754dbf4a08b548fa98db39cd7203e537/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980443%27 HTTP/1.1" 200 None
2026-03-24 22:54:51 [ayvens.be] INFO: Saving data for 1980443: {'created_time': 1774392891.166488, 'last_price_update_time': 1774392891.166499, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980443') HTTP/1.1" 204 0
2026-03-24 22:54:51 [ayvens.be] INFO: Found listing with ID: 1980446
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980446%27 HTTP/1.1" 200 None
2026-03-24 22:54:51 [ayvens.be] INFO: Scrape type for 1980446: 1
2026-03-24 22:54:51 [ayvens.be] INFO: Extracting data for car ID: 1980446
2026-03-24 22:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1980446
2026-03-24 22:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798339c6-1db7-59a9-a77e-53ec4e304705 with scrape type 1
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/1.jpg not downloaded yet
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/2.jpg not downloaded yet
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b78e90>
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/9.jpg saved to cache
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b6a10>
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/10.jpg saved to cache
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945a250>
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F4aca5f696dc64ceb9379d446c01abfe2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/8.jpg saved to cache
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c7d428a-e542-54a6-9d6b-4241d510c1db
2026-03-24 22:54:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c7d428a-e542-54a6-9d6b-4241d510c1db, skipping ID generation
2026-03-24 22:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7d428a-e542-54a6-9d6b-4241d510c1db with scrape type 1
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c7d428a-e542-54a6-9d6b-4241d510c1db sending to next pipeline
2026-03-24 22:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c7d428a-e542-54a6-9d6b-4241d510c1db, identifier: 1980444
2026-03-24 22:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/3.jpg not downloaded yet
2026-03-24 22:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1980444
2026-03-24 22:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1980444
2026-03-24 22:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1980444 to the API
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c7d428a-e542-54a6-9d6b-4241d510c1db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 97195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c7d428a-e542-54a6-9d6b-4241d510c1db/8c7d428a-e542-54a6-9d6b-4241d510c1db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/4aca5f696dc64ceb9379d446c01abfe2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 518D 100KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 518D 100KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980444%27 HTTP/1.1" 200 None
2026-03-24 22:54:51 [ayvens.be] INFO: Saving data for 1980444: {'created_time': 1774392891.974302, 'last_price_update_time': 1774392891.974311, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980444') HTTP/1.1" 204 0
2026-03-24 22:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/4.jpg not downloaded yet
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/5.jpg not downloaded yet
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd550>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/3.jpg saved to cache
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/6.jpg not downloaded yet
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/7.jpg not downloaded yet
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bed50>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/2.jpg saved to cache
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c590>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/1.jpg saved to cache
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838d690>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/4.jpg saved to cache
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/8.jpg not downloaded yet
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/9.jpg not downloaded yet
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/10.jpg not downloaded yet
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4450>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/5.jpg saved to cache
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28190>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/7.jpg saved to cache
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772bd0>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/6.jpg saved to cache
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:52 [ayvens.be] INFO: Found listing with ID: 1980447
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980447%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [ayvens.be] INFO: Scrape type for 1980447: 1
2026-03-24 22:54:52 [ayvens.be] INFO: Extracting data for car ID: 1980447
2026-03-24 22:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1980447
2026-03-24 22:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8056c5c7-d393-5672-9245-8472e244201c with scrape type 1
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/1.jpg not downloaded yet
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/2.jpg not downloaded yet
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422b10>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/8.jpg saved to cache
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/3.jpg not downloaded yet
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/4.jpg not downloaded yet
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/5.jpg not downloaded yet
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aecf5d0>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/9.jpg saved to cache
2026-03-24 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a297d0>
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/2.jpg saved to cache
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009130910>
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/1.jpg saved to cache
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/6.jpg not downloaded yet
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/7.jpg not downloaded yet
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838de90>
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/3.jpg saved to cache
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009762990>
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/4.jpg saved to cache
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018390>
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F371d37fe8f304f3d8de2405c2233e458%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/10.jpg saved to cache
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82b27291-52b1-5bb8-8777-db035e76e519
2026-03-24 22:54:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82b27291-52b1-5bb8-8777-db035e76e519, skipping ID generation
2026-03-24 22:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b27291-52b1-5bb8-8777-db035e76e519 with scrape type 1
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82b27291-52b1-5bb8-8777-db035e76e519 sending to next pipeline
2026-03-24 22:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82b27291-52b1-5bb8-8777-db035e76e519, identifier: 1980445
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009640410>
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/5.jpg saved to cache
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094abd10>
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/6.jpg saved to cache
2026-03-24 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1980445
2026-03-24 22:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1980445
2026-03-24 22:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1980445 to the API
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '82b27291-52b1-5bb8-8777-db035e76e519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 167994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b27291-52b1-5bb8-8777-db035e76e519/82b27291-52b1-5bb8-8777-db035e76e519_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/371d37fe8f304f3d8de2405c2233e458/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 530E 200KW XDRIVE AUTO TOURING',
 'transmission': 'manual',
 'trim': '2.0 530E 200KW XDRIVE AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980445%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [ayvens.be] INFO: Saving data for 1980445: {'created_time': 1774392894.230038, 'last_price_update_time': 1774392894.230047, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980445') HTTP/1.1" 204 0
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/8.jpg not downloaded yet
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/9.jpg not downloaded yet
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/10.jpg not downloaded yet
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [ayvens.be] INFO: Found listing with ID: 1980448
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980448%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [ayvens.be] INFO: Scrape type for 1980448: 1
2026-03-24 22:54:54 [ayvens.be] INFO: Extracting data for car ID: 1980448
2026-03-24 22:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1980448
2026-03-24 22:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with scrape type 1
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/1.jpg not downloaded yet
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/2.jpg not downloaded yet
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/3.jpg not downloaded yet
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018f10>
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/1.jpg saved to cache
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bc090>
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/10.jpg saved to cache
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009113910>
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/2.jpg saved to cache
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/4.jpg not downloaded yet
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/5.jpg not downloaded yet
2026-03-24 22:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/6.jpg not downloaded yet
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839a110>
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/8.jpg saved to cache
2026-03-24 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083baed0>
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/7.jpg saved to cache
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b79390>
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F66d4a8bde07b4433a64443409af55ed2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/9.jpg saved to cache
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 798339c6-1db7-59a9-a77e-53ec4e304705
2026-03-24 22:54:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 798339c6-1db7-59a9-a77e-53ec4e304705, skipping ID generation
2026-03-24 22:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798339c6-1db7-59a9-a77e-53ec4e304705 with scrape type 1
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 798339c6-1db7-59a9-a77e-53ec4e304705 sending to next pipeline
2026-03-24 22:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 798339c6-1db7-59a9-a77e-53ec4e304705, identifier: 1980446
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b6990>
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/3.jpg saved to cache
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091124d0>
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/5.jpg saved to cache
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8dd0>
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/6.jpg saved to cache
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1980446
2026-03-24 22:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1980446
2026-03-24 22:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1980446 to the API
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '798339c6-1db7-59a9-a77e-53ec4e304705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 100208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798339c6-1db7-59a9-a77e-53ec4e304705/798339c6-1db7-59a9-a77e-53ec4e304705_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/66d4a8bde07b4433a64443409af55ed2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980446%27 HTTP/1.1" 200 None
2026-03-24 22:54:55 [ayvens.be] INFO: Saving data for 1980446: {'created_time': 1774392895.68412, 'last_price_update_time': 1774392895.684131, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980446') HTTP/1.1" 204 0
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/7.jpg not downloaded yet
2026-03-24 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/8.jpg not downloaded yet
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091907d0>
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/8.jpg saved to cache
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8ed0>
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/7.jpg saved to cache
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28190>
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/9.jpg saved to cache
2026-03-24 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/9.jpg not downloaded yet
2026-03-24 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/10.jpg not downloaded yet
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bee90>
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/4.jpg saved to cache
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ccdd0>
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fbbf58a56e459439d9e2cab15cca4974a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/10.jpg saved to cache
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8056c5c7-d393-5672-9245-8472e244201c
2026-03-24 22:54:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8056c5c7-d393-5672-9245-8472e244201c, skipping ID generation
2026-03-24 22:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8056c5c7-d393-5672-9245-8472e244201c with scrape type 1
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8056c5c7-d393-5672-9245-8472e244201c sending to next pipeline
2026-03-24 22:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8056c5c7-d393-5672-9245-8472e244201c, identifier: 1980447
2026-03-24 22:54:56 [ayvens.be] INFO: Found listing with ID: 1980449
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980449%27 HTTP/1.1" 200 None
2026-03-24 22:54:56 [ayvens.be] INFO: Scrape type for 1980449: 1
2026-03-24 22:54:56 [ayvens.be] INFO: Extracting data for car ID: 1980449
2026-03-24 22:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1980449
2026-03-24 22:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f362f5-e8a6-53e4-8caa-f5b14f161748 with scrape type 1
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/1.jpg not downloaded yet
2026-03-24 22:54:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1980447
2026-03-24 22:54:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1980447
2026-03-24 22:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1980447 to the API
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8056c5c7-d393-5672-9245-8472e244201c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 123049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8056c5c7-d393-5672-9245-8472e244201c/8056c5c7-d393-5672-9245-8472e244201c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/bbf58a56e459439d9e2cab15cca4974a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318IA (115KW) AUTO TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318IA (115KW) AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980447%27 HTTP/1.1" 200 None
2026-03-24 22:54:56 [ayvens.be] INFO: Saving data for 1980447: {'created_time': 1774392896.611824, 'last_price_update_time': 1774392896.611839, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980447') HTTP/1.1" 204 0
2026-03-24 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/2.jpg not downloaded yet
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613f50>
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/1.jpg saved to cache
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/3.jpg not downloaded yet
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/4.jpg not downloaded yet
2026-03-24 22:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/5.jpg not downloaded yet
2026-03-24 22:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093daa90>
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/2.jpg saved to cache
2026-03-24 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d57d0>
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/3.jpg saved to cache
2026-03-24 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970e250>
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/4.jpg saved to cache
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/6.jpg not downloaded yet
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/7.jpg not downloaded yet
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009616490>
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/5.jpg saved to cache
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334d50>
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/6.jpg saved to cache
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/8.jpg not downloaded yet
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/9.jpg not downloaded yet
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008370550>
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/7.jpg saved to cache
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/10.jpg not downloaded yet
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [ayvens.be] INFO: Found listing with ID: 1980450
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980450%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [ayvens.be] INFO: Scrape type for 1980450: 1
2026-03-24 22:54:58 [ayvens.be] INFO: Extracting data for car ID: 1980450
2026-03-24 22:54:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1980450
2026-03-24 22:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8418b0c-8e4b-50f5-ba81-68414125e1f9 with scrape type 1
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/1.jpg not downloaded yet
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110610>
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/8.jpg saved to cache
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097602d0>
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/1.jpg saved to cache
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce0d0>
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/2.jpg saved to cache
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/2.jpg not downloaded yet
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/3.jpg not downloaded yet
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4610>
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/9.jpg saved to cache
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/4.jpg not downloaded yet
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/5.jpg not downloaded yet
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a9010>
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F0a429b43a90848d7bbcfe4579e21a081%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/10.jpg saved to cache
2026-03-24 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1
2026-03-24 22:54:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1, skipping ID generation
2026-03-24 22:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with scrape type 1
2026-03-24 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 sending to next pipeline
2026-03-24 22:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1, identifier: 1980448
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d7a10>
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/3.jpg saved to cache
2026-03-24 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/6.jpg not downloaded yet
2026-03-24 22:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1980448
2026-03-24 22:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1980448
2026-03-24 22:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1980448 to the API
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bc44d0a9-f1ab-5254-a16c-d37ec9f284b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 61928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 961723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 917618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc44d0a9-f1ab-5254-a16c-d37ec9f284b1/bc44d0a9-f1ab-5254-a16c-d37ec9f284b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 862145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/0a429b43a90848d7bbcfe4579e21a081/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980448%27 HTTP/1.1" 200 None
2026-03-24 22:54:59 [ayvens.be] INFO: Saving data for 1980448: {'created_time': 1774392899.773418, 'last_price_update_time': 1774392899.773429, 'auction_closing_time': 1774530000.0}
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980448') HTTP/1.1" 204 0
2026-03-24 22:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/7.jpg not downloaded yet
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1a8e90>
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/5.jpg saved to cache
2026-03-24 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009407b10>
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/4.jpg saved to cache
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091aec90>
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/6.jpg saved to cache
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/8.jpg not downloaded yet
2026-03-24 22:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938dd90>
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/7.jpg saved to cache
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009141810>
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/8.jpg saved to cache
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/9.jpg not downloaded yet
2026-03-24 22:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/10.jpg not downloaded yet
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970dfd0>
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/9.jpg saved to cache
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a29450>
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F1e92406d03e64c4ca5d46c0ca596e416%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/10.jpg saved to cache
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45f362f5-e8a6-53e4-8caa-f5b14f161748
2026-03-24 22:55:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45f362f5-e8a6-53e4-8caa-f5b14f161748, skipping ID generation
2026-03-24 22:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f362f5-e8a6-53e4-8caa-f5b14f161748 with scrape type 1
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45f362f5-e8a6-53e4-8caa-f5b14f161748 sending to next pipeline
2026-03-24 22:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 45f362f5-e8a6-53e4-8caa-f5b14f161748, identifier: 1980449
2026-03-24 22:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1980449
2026-03-24 22:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1980449
2026-03-24 22:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1980449 to the API
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '45f362f5-e8a6-53e4-8caa-f5b14f161748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 18362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f362f5-e8a6-53e4-8caa-f5b14f161748/45f362f5-e8a6-53e4-8caa-f5b14f161748_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/1e92406d03e64c4ca5d46c0ca596e416/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'vin': None,
 'year': 2021}
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980449%27 HTTP/1.1" 200 None
2026-03-24 22:55:00 [ayvens.be] INFO: Saving data for 1980449: {'created_time': 1774392900.945955, 'last_price_update_time': 1774392900.945964, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980449') HTTP/1.1" 204 0
2026-03-24 22:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:00 [ayvens.be] INFO: Found listing with ID: 1980451
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980451%27 HTTP/1.1" 200 None
2026-03-24 22:55:00 [ayvens.be] INFO: Scrape type for 1980451: 1
2026-03-24 22:55:00 [ayvens.be] INFO: Extracting data for car ID: 1980451
2026-03-24 22:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1980451
2026-03-24 22:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71689947-0945-541e-84e9-3ae7080dcfea with scrape type 1
2026-03-24 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/1.jpg not downloaded yet
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b790>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/2.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008324f90>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/3.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187d50>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/4.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/2.jpg not downloaded yet
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d7f10>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/1.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/3.jpg not downloaded yet
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d7b90>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/6.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/4.jpg not downloaded yet
2026-03-24 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd950>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/5.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/5.jpg not downloaded yet
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/6.jpg not downloaded yet
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946ed50>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/8.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a9050>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/7.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/7.jpg not downloaded yet
2026-03-24 22:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8090>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/9.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/8.jpg not downloaded yet
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/9.jpg not downloaded yet
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b1650>
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc3f60110206b444d977f04f78562d7d9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/10.jpg saved to cache
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8418b0c-8e4b-50f5-ba81-68414125e1f9
2026-03-24 22:55:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8418b0c-8e4b-50f5-ba81-68414125e1f9, skipping ID generation
2026-03-24 22:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8418b0c-8e4b-50f5-ba81-68414125e1f9 with scrape type 1
2026-03-24 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8418b0c-8e4b-50f5-ba81-68414125e1f9 sending to next pipeline
2026-03-24 22:55:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8418b0c-8e4b-50f5-ba81-68414125e1f9, identifier: 1980450
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/10.jpg not downloaded yet
2026-03-24 22:55:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1980450
2026-03-24 22:55:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1980450
2026-03-24 22:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1980450 to the API
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e8418b0c-8e4b-50f5-ba81-68414125e1f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 35359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8418b0c-8e4b-50f5-ba81-68414125e1f9/e8418b0c-8e4b-50f5-ba81-68414125e1f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c3f60110206b444d977f04f78562d7d9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.6 E-TECH 145 ZEN',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 145 ZEN',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980450%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [ayvens.be] INFO: Saving data for 1980450: {'created_time': 1774392902.386969, 'last_price_update_time': 1774392902.386978, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980450') HTTP/1.1" 204 0
2026-03-24 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:02 [ayvens.be] INFO: Found listing with ID: 1980452
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980452%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [ayvens.be] INFO: Scrape type for 1980452: 1
2026-03-24 22:55:02 [ayvens.be] INFO: Extracting data for car ID: 1980452
2026-03-24 22:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1980452
2026-03-24 22:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec46de6-e866-5be7-9224-6fd57651e59d with scrape type 1
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/1.jpg not downloaded yet
2026-03-24 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/2.jpg not downloaded yet
2026-03-24 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/3.jpg not downloaded yet
2026-03-24 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/4.jpg not downloaded yet
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/5.jpg not downloaded yet
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/6.jpg not downloaded yet
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946ffd0>
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/3.jpg saved to cache
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967cd50>
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/4.jpg saved to cache
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911de50>
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/2.jpg saved to cache
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/7.jpg not downloaded yet
2026-03-24 22:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/8.jpg not downloaded yet
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb110>
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/1.jpg saved to cache
2026-03-24 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564050>
2026-03-24 22:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/5.jpg saved to cache
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2990>
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/6.jpg saved to cache
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3990>
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/8.jpg saved to cache
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009176490>
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/7.jpg saved to cache
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/9.jpg not downloaded yet
2026-03-24 22:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/10.jpg not downloaded yet
2026-03-24 22:55:03 [ayvens.be] INFO: Found listing with ID: 1980453
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980453%27 HTTP/1.1" 200 None
2026-03-24 22:55:03 [ayvens.be] INFO: Scrape type for 1980453: 1
2026-03-24 22:55:03 [ayvens.be] INFO: Extracting data for car ID: 1980453
2026-03-24 22:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1980453
2026-03-24 22:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df76a12-ab1c-5bdf-9805-12191f762d3c with scrape type 1
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/1.jpg not downloaded yet
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917f650>
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/9.jpg saved to cache
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/2.jpg not downloaded yet
2026-03-24 22:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/3.jpg not downloaded yet
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019750>
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fe2e5eb519c8f49ab816e474ff6fa5d00%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/10.jpg saved to cache
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71689947-0945-541e-84e9-3ae7080dcfea
2026-03-24 22:55:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71689947-0945-541e-84e9-3ae7080dcfea, skipping ID generation
2026-03-24 22:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71689947-0945-541e-84e9-3ae7080dcfea with scrape type 1
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71689947-0945-541e-84e9-3ae7080dcfea sending to next pipeline
2026-03-24 22:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71689947-0945-541e-84e9-3ae7080dcfea, identifier: 1980451
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/4.jpg not downloaded yet
2026-03-24 22:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1980451
2026-03-24 22:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1980451
2026-03-24 22:55:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1980451 to the API
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '71689947-0945-541e-84e9-3ae7080dcfea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 144429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71689947-0945-541e-84e9-3ae7080dcfea/71689947-0945-541e-84e9-3ae7080dcfea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/e2e5eb519c8f49ab816e474ff6fa5d00/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 30 TDI S TRONIC BUS. ED.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS. ED.',
 'vin': None,
 'year': 2021}
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980451%27 HTTP/1.1" 200 None
2026-03-24 22:55:04 [ayvens.be] INFO: Saving data for 1980451: {'created_time': 1774392904.095498, 'last_price_update_time': 1774392904.095508, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980451') HTTP/1.1" 204 0
2026-03-24 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/5.jpg not downloaded yet
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834c390>
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/3.jpg saved to cache
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4d50>
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/2.jpg saved to cache
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310cd0>
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/4.jpg saved to cache
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3c90>
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/1.jpg saved to cache
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/6.jpg not downloaded yet
2026-03-24 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/7.jpg not downloaded yet
2026-03-24 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970fad0>
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/6.jpg saved to cache
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009142890>
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/5.jpg saved to cache
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/8.jpg not downloaded yet
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/9.jpg not downloaded yet
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a284d0>
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/7.jpg saved to cache
2026-03-24 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910ecd0>
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/1.jpg saved to cache
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913f9d0>
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/8.jpg saved to cache
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/10.jpg not downloaded yet
2026-03-24 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009470710>
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/2.jpg saved to cache
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:05 [ayvens.be] INFO: Found listing with ID: 1980454
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980454%27 HTTP/1.1" 200 None
2026-03-24 22:55:05 [ayvens.be] INFO: Scrape type for 1980454: 1
2026-03-24 22:55:05 [ayvens.be] INFO: Extracting data for car ID: 1980454
2026-03-24 22:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1980454
2026-03-24 22:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with scrape type 1
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/1.jpg not downloaded yet
2026-03-24 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/2.jpg not downloaded yet
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093da750>
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/10.jpg saved to cache
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009616b50>
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252Fd35669029d7449229d4cccdb7d0444c4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/9.jpg saved to cache
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ec46de6-e866-5be7-9224-6fd57651e59d
2026-03-24 22:55:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ec46de6-e866-5be7-9224-6fd57651e59d, skipping ID generation
2026-03-24 22:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec46de6-e866-5be7-9224-6fd57651e59d with scrape type 1
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ec46de6-e866-5be7-9224-6fd57651e59d sending to next pipeline
2026-03-24 22:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4ec46de6-e866-5be7-9224-6fd57651e59d, identifier: 1980452
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b296bd0>
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/3.jpg saved to cache
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009174d50>
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/4.jpg saved to cache
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/3.jpg not downloaded yet
2026-03-24 22:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1980452
2026-03-24 22:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1980452
2026-03-24 22:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1980452 to the API
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4ec46de6-e866-5be7-9224-6fd57651e59d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 60599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec46de6-e866-5be7-9224-6fd57651e59d/4ec46de6-e866-5be7-9224-6fd57651e59d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/d35669029d7449229d4cccdb7d0444c4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 1.4 TSI MSQ VARIANT GTE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.4 TSI MSQ VARIANT GTE BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980452%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [ayvens.be] INFO: Saving data for 1980452: {'created_time': 1774392906.10062, 'last_price_update_time': 1774392906.100629, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980452') HTTP/1.1" 204 0
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/4.jpg not downloaded yet
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008385410>
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/5.jpg saved to cache
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ceb10>
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/7.jpg saved to cache
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a8050>
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/6.jpg saved to cache
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/5.jpg not downloaded yet
2026-03-24 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/6.jpg not downloaded yet
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/7.jpg not downloaded yet
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/8.jpg not downloaded yet
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/9.jpg not downloaded yet
2026-03-24 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/10.jpg not downloaded yet
2026-03-24 22:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:06 [ayvens.be] INFO: Found listing with ID: 1980455
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980455%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [ayvens.be] INFO: Scrape type for 1980455: 1
2026-03-24 22:55:06 [ayvens.be] INFO: Extracting data for car ID: 1980455
2026-03-24 22:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1980455
2026-03-24 22:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d66156-2e3e-548c-8bbb-85097e13616c with scrape type 1
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/1.jpg not downloaded yet
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334e90>
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/8.jpg saved to cache
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/2.jpg not downloaded yet
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944bed0>
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/10.jpg saved to cache
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336b10>
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F539ab571b771408c829774e612aea98e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/9.jpg saved to cache
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1df76a12-ab1c-5bdf-9805-12191f762d3c
2026-03-24 22:55:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1df76a12-ab1c-5bdf-9805-12191f762d3c, skipping ID generation
2026-03-24 22:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df76a12-ab1c-5bdf-9805-12191f762d3c with scrape type 1
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1df76a12-ab1c-5bdf-9805-12191f762d3c sending to next pipeline
2026-03-24 22:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1df76a12-ab1c-5bdf-9805-12191f762d3c, identifier: 1980453
2026-03-24 22:55:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at -3 pages/min), scraped 442 items (at 36 items/min)
2026-03-24 22:55:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/3.jpg not downloaded yet
2026-03-24 22:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1980453
2026-03-24 22:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1980453
2026-03-24 22:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1980453 to the API
2026-03-24 22:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'STD',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '1df76a12-ab1c-5bdf-9805-12191f762d3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'MIRAI',
 'odometer': 1895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df76a12-ab1c-5bdf-9805-12191f762d3c/1df76a12-ab1c-5bdf-9805-12191f762d3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/539ab571b771408c829774e612aea98e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA MIRAI Mirai Fuel Cell',
 'transmission': 'automatic',
 'trim': 'Mirai Fuel Cell',
 'vin': None,
 'year': 2020}
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980453%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [ayvens.be] INFO: Saving data for 1980453: {'created_time': 1774392907.213972, 'last_price_update_time': 1774392907.213981, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980453') HTTP/1.1" 204 0
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938da10>
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/1.jpg saved to cache
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913ec50>
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/2.jpg saved to cache
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/4.jpg not downloaded yet
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/5.jpg not downloaded yet
2026-03-24 22:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/6.jpg not downloaded yet
2026-03-24 22:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/7.jpg not downloaded yet
2026-03-24 22:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/8.jpg not downloaded yet
2026-03-24 22:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/9.jpg not downloaded yet
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/10.jpg not downloaded yet
2026-03-24 22:55:07 [ayvens.be] INFO: Found listing with ID: 1980456
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980456%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [ayvens.be] INFO: Scrape type for 1980456: 1
2026-03-24 22:55:07 [ayvens.be] INFO: Extracting data for car ID: 1980456
2026-03-24 22:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a55df8c8-1139-5e88-9924-9e0bf3961638 with identifier: 1980456
2026-03-24 22:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a55df8c8-1139-5e88-9924-9e0bf3961638 with scrape type 1
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/1.jpg not downloaded yet
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009684d10>
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/4.jpg saved to cache
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/2.jpg not downloaded yet
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083157d0>
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/5.jpg saved to cache
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872250>
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/9.jpg saved to cache
2026-03-24 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638790>
2026-03-24 22:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/3.jpg saved to cache
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009629b50>
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/7.jpg saved to cache
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/3.jpg not downloaded yet
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/4.jpg not downloaded yet
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bcbd0>
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/8.jpg saved to cache
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b6e50>
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/6.jpg saved to cache
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967c090>
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F4e1120ce625f466ca10a79d7d6af54e3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/10.jpg saved to cache
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021
2026-03-24 22:55:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021, skipping ID generation
2026-03-24 22:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with scrape type 1
2026-03-24 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 sending to next pipeline
2026-03-24 22:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021, identifier: 1980454
2026-03-24 22:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1980454
2026-03-24 22:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1980454
2026-03-24 22:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1980454 to the API
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6f95b6f5-ec00-5c09-9f02-b54ca7a1e021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 92915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f95b6f5-ec00-5c09-9f02-b54ca7a1e021/6f95b6f5-ec00-5c09-9f02-b54ca7a1e021_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/4e1120ce625f466ca10a79d7d6af54e3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2020}
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980454%27 HTTP/1.1" 200 None
2026-03-24 22:55:08 [ayvens.be] INFO: Saving data for 1980454: {'created_time': 1774392908.961568, 'last_price_update_time': 1774392908.96158, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980454') HTTP/1.1" 204 0
2026-03-24 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/5.jpg not downloaded yet
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/6.jpg not downloaded yet
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/7.jpg not downloaded yet
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/8.jpg not downloaded yet
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/9.jpg not downloaded yet
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/10.jpg not downloaded yet
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b4b10>
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/2.jpg saved to cache
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095649d0>
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/3.jpg saved to cache
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187350>
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/5.jpg saved to cache
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:09 [ayvens.be] INFO: Found listing with ID: 1980457
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980457%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [ayvens.be] INFO: Scrape type for 1980457: 1
2026-03-24 22:55:09 [ayvens.be] INFO: Extracting data for car ID: 1980457
2026-03-24 22:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38e5fee7-112c-57a0-a045-c2601d471e9d with identifier: 1980457
2026-03-24 22:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38e5fee7-112c-57a0-a045-c2601d471e9d with scrape type 1
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/1.jpg not downloaded yet
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cf150>
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/1.jpg saved to cache
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/2.jpg not downloaded yet
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/3.jpg not downloaded yet
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0b10>
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/4.jpg saved to cache
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938cf90>
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/6.jpg saved to cache
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009467e50>
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/7.jpg saved to cache
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/4.jpg not downloaded yet
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/5.jpg not downloaded yet
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/6.jpg not downloaded yet
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/7.jpg not downloaded yet
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/8.jpg not downloaded yet
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/9.jpg not downloaded yet
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492cd0>
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/3.jpg saved to cache
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464250>
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/10.jpg saved to cache
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/10.jpg not downloaded yet
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493b10>
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/9.jpg saved to cache
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:10 [ayvens.be] INFO: Found listing with ID: 1980458
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980458%27 HTTP/1.1" 200 None
2026-03-24 22:55:10 [ayvens.be] INFO: Scrape type for 1980458: 1
2026-03-24 22:55:10 [ayvens.be] INFO: Extracting data for car ID: 1980458
2026-03-24 22:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6de310f-3ed4-54eb-93fd-40cf284d08ea with identifier: 1980458
2026-03-24 22:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6de310f-3ed4-54eb-93fd-40cf284d08ea with scrape type 1
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/1.jpg not downloaded yet
2026-03-24 22:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/2.jpg not downloaded yet
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a7510>
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/1.jpg saved to cache
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110050>
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/2.jpg saved to cache
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d6350>
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3f214e08301d47e3ac21b5abc35f553e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/8.jpg saved to cache
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85d66156-2e3e-548c-8bbb-85097e13616c
2026-03-24 22:55:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 85d66156-2e3e-548c-8bbb-85097e13616c, skipping ID generation
2026-03-24 22:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d66156-2e3e-548c-8bbb-85097e13616c with scrape type 1
2026-03-24 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85d66156-2e3e-548c-8bbb-85097e13616c sending to next pipeline
2026-03-24 22:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85d66156-2e3e-548c-8bbb-85097e13616c, identifier: 1980455
2026-03-24 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345210>
2026-03-24 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/4.jpg saved to cache
2026-03-24 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008380e50>
2026-03-24 22:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/5.jpg saved to cache
2026-03-24 22:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1980455
2026-03-24 22:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1980455
2026-03-24 22:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1980455 to the API
2026-03-24 22:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '85d66156-2e3e-548c-8bbb-85097e13616c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 93888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85d66156-2e3e-548c-8bbb-85097e13616c/85d66156-2e3e-548c-8bbb-85097e13616c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3f214e08301d47e3ac21b5abc35f553e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI 81KW ACTIVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980455%27 HTTP/1.1" 200 None
2026-03-24 22:55:12 [ayvens.be] INFO: Saving data for 1980455: {'created_time': 1774392912.478578, 'last_price_update_time': 1774392912.47859, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980455') HTTP/1.1" 204 0
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/3.jpg not downloaded yet
2026-03-24 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/4.jpg not downloaded yet
2026-03-24 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915cd50>
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/7.jpg saved to cache
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/5.jpg not downloaded yet
2026-03-24 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/6.jpg not downloaded yet
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009684c50>
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/6.jpg saved to cache
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639850>
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/1.jpg saved to cache
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/7.jpg not downloaded yet
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093dbad0>
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/8.jpg saved to cache
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834fc50>
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/3.jpg saved to cache
2026-03-24 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc4990>
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/2.jpg saved to cache
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/8.jpg not downloaded yet
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aac50>
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/10.jpg saved to cache
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ef0d0>
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fa83dcdbc503d450994116fd3deff966e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/9.jpg saved to cache
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a55df8c8-1139-5e88-9924-9e0bf3961638
2026-03-24 22:55:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a55df8c8-1139-5e88-9924-9e0bf3961638, skipping ID generation
2026-03-24 22:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a55df8c8-1139-5e88-9924-9e0bf3961638 with scrape type 1
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a55df8c8-1139-5e88-9924-9e0bf3961638 sending to next pipeline
2026-03-24 22:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a55df8c8-1139-5e88-9924-9e0bf3961638, identifier: 1980456
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/9.jpg not downloaded yet
2026-03-24 22:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a55df8c8-1139-5e88-9924-9e0bf3961638 with identifier: 1980456
2026-03-24 22:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a55df8c8-1139-5e88-9924-9e0bf3961638 with identifier: 1980456
2026-03-24 22:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a55df8c8-1139-5e88-9924-9e0bf3961638 with identifier: 1980456 to the API
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a55df8c8-1139-5e88-9924-9e0bf3961638',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 200721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 928627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 929963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55df8c8-1139-5e88-9924-9e0bf3961638/a55df8c8-1139-5e88-9924-9e0bf3961638_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/a83dcdbc503d450994116fd3deff966e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980456%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [ayvens.be] INFO: Saving data for 1980456: {'created_time': 1774392913.702157, 'last_price_update_time': 1774392913.702166, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980456') HTTP/1.1" 204 0
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/10.jpg not downloaded yet
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3010>
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/4.jpg saved to cache
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980459
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980459%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [ayvens.be] INFO: Scrape type for 1980459: 1
2026-03-24 22:55:13 [ayvens.be] INFO: Extracting data for car ID: 1980459
2026-03-24 22:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with identifier: 1980459
2026-03-24 22:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with scrape type 1
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/1.jpg not downloaded yet
2026-03-24 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/2.jpg not downloaded yet
2026-03-24 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/3.jpg not downloaded yet
2026-03-24 22:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/4.jpg not downloaded yet
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/5.jpg not downloaded yet
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009789290>
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/5.jpg saved to cache
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/6.jpg not downloaded yet
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/7.jpg not downloaded yet
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/8.jpg not downloaded yet
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009718b90>
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/9.jpg saved to cache
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097912d0>
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/8.jpg saved to cache
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1dd0>
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/10.jpg saved to cache
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009703b50>
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/7.jpg saved to cache
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008370390>
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Ff3890ab15b1640f0a1c75c8c484fd42e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/6.jpg saved to cache
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38e5fee7-112c-57a0-a045-c2601d471e9d
2026-03-24 22:55:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38e5fee7-112c-57a0-a045-c2601d471e9d, skipping ID generation
2026-03-24 22:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38e5fee7-112c-57a0-a045-c2601d471e9d with scrape type 1
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38e5fee7-112c-57a0-a045-c2601d471e9d sending to next pipeline
2026-03-24 22:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 38e5fee7-112c-57a0-a045-c2601d471e9d, identifier: 1980457
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b56dd0>
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/1.jpg saved to cache
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971a110>
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/2.jpg saved to cache
2026-03-24 22:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 38e5fee7-112c-57a0-a045-c2601d471e9d with identifier: 1980457
2026-03-24 22:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 38e5fee7-112c-57a0-a045-c2601d471e9d with identifier: 1980457
2026-03-24 22:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 38e5fee7-112c-57a0-a045-c2601d471e9d with identifier: 1980457 to the API
2026-03-24 22:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'STD',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '38e5fee7-112c-57a0-a045-c2601d471e9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'MIRAI',
 'odometer': 16613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38e5fee7-112c-57a0-a045-c2601d471e9d/38e5fee7-112c-57a0-a045-c2601d471e9d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/f3890ab15b1640f0a1c75c8c484fd42e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA MIRAI Mirai Fuel Cell',
 'transmission': 'automatic',
 'trim': 'Mirai Fuel Cell',
 'vin': None,
 'year': 2020}
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980457%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [ayvens.be] INFO: Saving data for 1980457: {'created_time': 1774392915.159899, 'last_price_update_time': 1774392915.159908, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980457') HTTP/1.1" 204 0
2026-03-24 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/9.jpg not downloaded yet
2026-03-24 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/10.jpg not downloaded yet
2026-03-24 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:15 [ayvens.be] INFO: Found listing with ID: 1980460
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980460%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [ayvens.be] INFO: Scrape type for 1980460: 1
2026-03-24 22:55:15 [ayvens.be] INFO: Extracting data for car ID: 1980460
2026-03-24 22:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1980460
2026-03-24 22:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923415d3-d6d4-571e-8e07-9b822810782d with scrape type 1
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/1.jpg not downloaded yet
2026-03-24 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/2.jpg not downloaded yet
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/3.jpg not downloaded yet
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639a10>
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/3.jpg saved to cache
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/4.jpg not downloaded yet
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018d10>
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/4.jpg saved to cache
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639f50>
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/6.jpg saved to cache
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983a3d0>
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/7.jpg saved to cache
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019690>
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/8.jpg saved to cache
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0090188d0>
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/10.jpg saved to cache
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/5.jpg not downloaded yet
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/6.jpg not downloaded yet
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018e10>
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/9.jpg saved to cache
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091338d0>
2026-03-24 22:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fa72b6cf4de7b46dfa8661eba00467610%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/5.jpg saved to cache
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6de310f-3ed4-54eb-93fd-40cf284d08ea
2026-03-24 22:55:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6de310f-3ed4-54eb-93fd-40cf284d08ea, skipping ID generation
2026-03-24 22:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6de310f-3ed4-54eb-93fd-40cf284d08ea with scrape type 1
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6de310f-3ed4-54eb-93fd-40cf284d08ea sending to next pipeline
2026-03-24 22:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c6de310f-3ed4-54eb-93fd-40cf284d08ea, identifier: 1980458
2026-03-24 22:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c6de310f-3ed4-54eb-93fd-40cf284d08ea with identifier: 1980458
2026-03-24 22:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c6de310f-3ed4-54eb-93fd-40cf284d08ea with identifier: 1980458
2026-03-24 22:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c6de310f-3ed4-54eb-93fd-40cf284d08ea with identifier: 1980458 to the API
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c6de310f-3ed4-54eb-93fd-40cf284d08ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 113184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6de310f-3ed4-54eb-93fd-40cf284d08ea/c6de310f-3ed4-54eb-93fd-40cf284d08ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/a72b6cf4de7b46dfa8661eba00467610/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 2.0 CRTDI 85KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980458%27 HTTP/1.1" 200 None
2026-03-24 22:55:16 [ayvens.be] INFO: Saving data for 1980458: {'created_time': 1774392916.868991, 'last_price_update_time': 1774392916.869001, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980458') HTTP/1.1" 204 0
2026-03-24 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/7.jpg not downloaded yet
2026-03-24 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/8.jpg not downloaded yet
2026-03-24 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/9.jpg not downloaded yet
2026-03-24 22:55:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/10.jpg not downloaded yet
2026-03-24 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980461
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980461%27 HTTP/1.1" 200 None
2026-03-24 22:55:16 [ayvens.be] INFO: Scrape type for 1980461: 1
2026-03-24 22:55:16 [ayvens.be] INFO: Extracting data for car ID: 1980461
2026-03-24 22:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with identifier: 1980461
2026-03-24 22:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with scrape type 1
2026-03-24 22:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/1.jpg not downloaded yet
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/2.jpg not downloaded yet
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b62d0>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/1.jpg saved to cache
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772750>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/7.jpg saved to cache
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911b510>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/6.jpg saved to cache
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009773a10>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/2.jpg saved to cache
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/3.jpg not downloaded yet
2026-03-24 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009640890>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/3.jpg saved to cache
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838d910>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/5.jpg saved to cache
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334990>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/4.jpg saved to cache
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b40d0>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/9.jpg saved to cache
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/4.jpg not downloaded yet
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/5.jpg not downloaded yet
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917f910>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/1.jpg saved to cache
2026-03-24 22:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c2c10>
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/2.jpg saved to cache
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/6.jpg not downloaded yet
2026-03-24 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/7.jpg not downloaded yet
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442150>
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/4.jpg saved to cache
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/8.jpg not downloaded yet
2026-03-24 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/9.jpg not downloaded yet
2026-03-24 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/10.jpg not downloaded yet
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02910>
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/6.jpg saved to cache
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613910>
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/3.jpg saved to cache
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097186d0>
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/5.jpg saved to cache
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009611c50>
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/10.jpg saved to cache
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:18 [ayvens.be] INFO: Found listing with ID: 1980462
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980462%27 HTTP/1.1" 200 None
2026-03-24 22:55:18 [ayvens.be] INFO: Scrape type for 1980462: 1
2026-03-24 22:55:18 [ayvens.be] INFO: Extracting data for car ID: 1980462
2026-03-24 22:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 560d6cee-62eb-5e33-9452-6c283758fabb with identifier: 1980462
2026-03-24 22:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 560d6cee-62eb-5e33-9452-6c283758fabb with scrape type 1
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/1.jpg not downloaded yet
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/2.jpg not downloaded yet
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008384550>
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fcbf250513e234cbaaccf08b47aee9e15%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/8.jpg saved to cache
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d
2026-03-24 22:55:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d, skipping ID generation
2026-03-24 22:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with scrape type 1
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ec8777e-7d1c-5539-adbe-9c85041f9c4d sending to next pipeline
2026-03-24 22:55:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d, identifier: 1980459
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f8750>
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/7.jpg saved to cache
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d8dd0>
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/8.jpg saved to cache
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/3.jpg not downloaded yet
2026-03-24 22:55:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with identifier: 1980459
2026-03-24 22:55:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with identifier: 1980459
2026-03-24 22:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0ec8777e-7d1c-5539-adbe-9c85041f9c4d with identifier: 1980459 to the API
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0ec8777e-7d1c-5539-adbe-9c85041f9c4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 111755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 865445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ec8777e-7d1c-5539-adbe-9c85041f9c4d/0ec8777e-7d1c-5539-adbe-9c85041f9c4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/cbf250513e234cbaaccf08b47aee9e15/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 2.0 XDRIVE18D 4WD AUTO 100KW',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE18D 4WD AUTO 100KW',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980459%27 HTTP/1.1" 200 None
2026-03-24 22:55:19 [ayvens.be] INFO: Saving data for 1980459: {'created_time': 1774392919.237962, 'last_price_update_time': 1774392919.237972, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980459') HTTP/1.1" 204 0
2026-03-24 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/4.jpg not downloaded yet
2026-03-24 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/5.jpg not downloaded yet
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098627d0>
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/9.jpg saved to cache
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/6.jpg not downloaded yet
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/7.jpg not downloaded yet
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009193f50>
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F765e8c9c6e7d4efbbd932f0dc376fc2d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/10.jpg saved to cache
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 923415d3-d6d4-571e-8e07-9b822810782d
2026-03-24 22:55:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 923415d3-d6d4-571e-8e07-9b822810782d, skipping ID generation
2026-03-24 22:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923415d3-d6d4-571e-8e07-9b822810782d with scrape type 1
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 923415d3-d6d4-571e-8e07-9b822810782d sending to next pipeline
2026-03-24 22:55:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 923415d3-d6d4-571e-8e07-9b822810782d, identifier: 1980460
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009862e90>
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/5.jpg saved to cache
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3c10>
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/3.jpg saved to cache
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/8.jpg not downloaded yet
2026-03-24 22:55:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1980460
2026-03-24 22:55:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1980460
2026-03-24 22:55:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 923415d3-d6d4-571e-8e07-9b822810782d with identifier: 1980460 to the API
2026-03-24 22:55:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '923415d3-d6d4-571e-8e07-9b822810782d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 118063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923415d3-d6d4-571e-8e07-9b822810782d/923415d3-d6d4-571e-8e07-9b822810782d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/765e8c9c6e7d4efbbd932f0dc376fc2d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980460%27 HTTP/1.1" 200 None
2026-03-24 22:55:20 [ayvens.be] INFO: Saving data for 1980460: {'created_time': 1774392920.18966, 'last_price_update_time': 1774392920.189671, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980460') HTTP/1.1" 204 0
2026-03-24 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/9.jpg not downloaded yet
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/10.jpg not downloaded yet
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761250>
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/1.jpg saved to cache
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009686550>
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/2.jpg saved to cache
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970cd90>
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/6.jpg saved to cache
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685f10>
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/4.jpg saved to cache
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834eb90>
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/7.jpg saved to cache
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:20 [ayvens.be] INFO: Found listing with ID: 1980463
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980463%27 HTTP/1.1" 200 None
2026-03-24 22:55:20 [ayvens.be] INFO: Scrape type for 1980463: 1
2026-03-24 22:55:20 [ayvens.be] INFO: Extracting data for car ID: 1980463
2026-03-24 22:55:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29499b34-8810-5b04-b474-a1d89d7eac20 with identifier: 1980463
2026-03-24 22:55:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29499b34-8810-5b04-b474-a1d89d7eac20 with scrape type 1
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/1.jpg not downloaded yet
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/2.jpg not downloaded yet
2026-03-24 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967db50>
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/9.jpg saved to cache
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/3.jpg not downloaded yet
2026-03-24 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/4.jpg not downloaded yet
2026-03-24 22:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/5.jpg not downloaded yet
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094412d0>
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/3.jpg saved to cache
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641fd0>
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/2.jpg saved to cache
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/6.jpg not downloaded yet
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/7.jpg not downloaded yet
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911e8d0>
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/10.jpg saved to cache
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f8610>
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/4.jpg saved to cache
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945e8d0>
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/1.jpg saved to cache
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963bdd0>
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fcfe5c7a624c442939f9b7729f429f43d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/8.jpg saved to cache
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72
2026-03-24 22:55:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72, skipping ID generation
2026-03-24 22:55:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with scrape type 1
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 sending to next pipeline
2026-03-24 22:55:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72, identifier: 1980461
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959edd0>
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/5.jpg saved to cache
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/8.jpg not downloaded yet
2026-03-24 22:55:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with identifier: 1980461
2026-03-24 22:55:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with identifier: 1980461
2026-03-24 22:55:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72 with identifier: 1980461 to the API
2026-03-24 22:55:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 190942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72/e8837ff7-3c2c-5e2f-8cb4-1f09a33b0d72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/cfe5c7a624c442939f9b7729f429f43d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2023}
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980461%27 HTTP/1.1" 200 None
2026-03-24 22:55:22 [ayvens.be] INFO: Saving data for 1980461: {'created_time': 1774392922.136052, 'last_price_update_time': 1774392922.136061, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980461') HTTP/1.1" 204 0
2026-03-24 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/9.jpg not downloaded yet
2026-03-24 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/10.jpg not downloaded yet
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3890>
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/6.jpg saved to cache
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:22 [ayvens.be] INFO: Found listing with ID: 1980464
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980464%27 HTTP/1.1" 200 None
2026-03-24 22:55:22 [ayvens.be] INFO: Scrape type for 1980464: 1
2026-03-24 22:55:22 [ayvens.be] INFO: Extracting data for car ID: 1980464
2026-03-24 22:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b45ee0fe-0bda-5382-a96b-95465e7f768d with identifier: 1980464
2026-03-24 22:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b45ee0fe-0bda-5382-a96b-95465e7f768d with scrape type 1
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/1.jpg not downloaded yet
2026-03-24 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/2.jpg not downloaded yet
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f2250>
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/1.jpg saved to cache
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d83d0>
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/7.jpg saved to cache
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/3.jpg not downloaded yet
2026-03-24 22:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/4.jpg not downloaded yet
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009703e90>
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/2.jpg saved to cache
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492ad0>
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/10.jpg saved to cache
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009616410>
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/9.jpg saved to cache
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493610>
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/3.jpg saved to cache
2026-03-24 22:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945a410>
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/4.jpg saved to cache
2026-03-24 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/5.jpg not downloaded yet
2026-03-24 22:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/6.jpg not downloaded yet
2026-03-24 22:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967f6d0>
2026-03-24 22:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F06b3896472504c9a992aa2faca39741e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/8.jpg saved to cache
2026-03-24 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 560d6cee-62eb-5e33-9452-6c283758fabb
2026-03-24 22:55:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 560d6cee-62eb-5e33-9452-6c283758fabb, skipping ID generation
2026-03-24 22:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 560d6cee-62eb-5e33-9452-6c283758fabb with scrape type 1
2026-03-24 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 560d6cee-62eb-5e33-9452-6c283758fabb sending to next pipeline
2026-03-24 22:55:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 560d6cee-62eb-5e33-9452-6c283758fabb, identifier: 1980462
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/7.jpg not downloaded yet
2026-03-24 22:55:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 560d6cee-62eb-5e33-9452-6c283758fabb with identifier: 1980462
2026-03-24 22:55:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 560d6cee-62eb-5e33-9452-6c283758fabb with identifier: 1980462
2026-03-24 22:55:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 560d6cee-62eb-5e33-9452-6c283758fabb with identifier: 1980462 to the API
2026-03-24 22:55:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '560d6cee-62eb-5e33-9452-6c283758fabb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 46181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 837104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560d6cee-62eb-5e33-9452-6c283758fabb/560d6cee-62eb-5e33-9452-6c283758fabb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/06b3896472504c9a992aa2faca39741e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 78KWH SINGLE MOTOR AUTO LONG RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH SINGLE MOTOR AUTO LONG RANGE',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980462%27 HTTP/1.1" 200 None
2026-03-24 22:55:24 [ayvens.be] INFO: Saving data for 1980462: {'created_time': 1774392924.656401, 'last_price_update_time': 1774392924.656411, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980462') HTTP/1.1" 204 0
2026-03-24 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/8.jpg not downloaded yet
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334890>
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/6.jpg saved to cache
2026-03-24 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d2950>
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/5.jpg saved to cache
2026-03-24 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009008c10>
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/8.jpg saved to cache
2026-03-24 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a02d0>
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/7.jpg saved to cache
2026-03-24 22:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/9.jpg not downloaded yet
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/10.jpg not downloaded yet
2026-03-24 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009702a50>
2026-03-24 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/9.jpg saved to cache
2026-03-24 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bb1d0>
2026-03-24 22:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F41efcabeb1804dcbaaa761f2610cb891%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/10.jpg saved to cache
2026-03-24 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29499b34-8810-5b04-b474-a1d89d7eac20
2026-03-24 22:55:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29499b34-8810-5b04-b474-a1d89d7eac20, skipping ID generation
2026-03-24 22:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29499b34-8810-5b04-b474-a1d89d7eac20 with scrape type 1
2026-03-24 22:55:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29499b34-8810-5b04-b474-a1d89d7eac20 sending to next pipeline
2026-03-24 22:55:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 29499b34-8810-5b04-b474-a1d89d7eac20, identifier: 1980463
2026-03-24 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 29499b34-8810-5b04-b474-a1d89d7eac20 with identifier: 1980463
2026-03-24 22:55:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 29499b34-8810-5b04-b474-a1d89d7eac20 with identifier: 1980463
2026-03-24 22:55:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 29499b34-8810-5b04-b474-a1d89d7eac20 with identifier: 1980463 to the API
2026-03-24 22:55:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '29499b34-8810-5b04-b474-a1d89d7eac20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 163279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29499b34-8810-5b04-b474-a1d89d7eac20/29499b34-8810-5b04-b474-a1d89d7eac20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/41efcabeb1804dcbaaa761f2610cb891/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 200 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980463%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [ayvens.be] INFO: Saving data for 1980463: {'created_time': 1774392926.617001, 'last_price_update_time': 1774392926.617011, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980463') HTTP/1.1" 204 0
2026-03-24 22:55:26 [ayvens.be] INFO: Found listing with ID: 1980465
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980465%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [ayvens.be] INFO: Scrape type for 1980465: 1
2026-03-24 22:55:26 [ayvens.be] INFO: Extracting data for car ID: 1980465
2026-03-24 22:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71df9a1a-6e8c-59ec-8e46-5338df18a265 with identifier: 1980465
2026-03-24 22:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71df9a1a-6e8c-59ec-8e46-5338df18a265 with scrape type 1
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/1.jpg not downloaded yet
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/2.jpg not downloaded yet
2026-03-24 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492050>
2026-03-24 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/1.jpg saved to cache
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/3.jpg not downloaded yet
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/4.jpg not downloaded yet
2026-03-24 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/5.jpg not downloaded yet
2026-03-24 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/6.jpg not downloaded yet
2026-03-24 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/7.jpg not downloaded yet
2026-03-24 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/8.jpg not downloaded yet
2026-03-24 22:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/9.jpg not downloaded yet
2026-03-24 22:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094678d0>
2026-03-24 22:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/2.jpg saved to cache
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838e350>
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/3.jpg saved to cache
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a0890>
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/4.jpg saved to cache
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/10.jpg not downloaded yet
2026-03-24 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:27 [ayvens.be] INFO: Found listing with ID: 1980466
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980466%27 HTTP/1.1" 200 None
2026-03-24 22:55:27 [ayvens.be] INFO: Scrape type for 1980466: 1
2026-03-24 22:55:27 [ayvens.be] INFO: Extracting data for car ID: 1980466
2026-03-24 22:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d63b12f7-960e-590b-8366-26d681e2e784 with identifier: 1980466
2026-03-24 22:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63b12f7-960e-590b-8366-26d681e2e784 with scrape type 1
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/1.jpg not downloaded yet
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed1210>
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/5.jpg saved to cache
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839b5d0>
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/7.jpg saved to cache
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959f950>
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/6.jpg saved to cache
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008383dd0>
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/8.jpg saved to cache
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916cbd0>
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/1.jpg saved to cache
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/2.jpg not downloaded yet
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/3.jpg not downloaded yet
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094416d0>
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/9.jpg saved to cache
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8f50>
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/3.jpg saved to cache
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/4.jpg not downloaded yet
2026-03-24 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009420ad0>
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/4.jpg saved to cache
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094237d0>
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/2.jpg saved to cache
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3050>
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/6.jpg saved to cache
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b86d0>
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/5.jpg saved to cache
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/5.jpg not downloaded yet
2026-03-24 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/6.jpg not downloaded yet
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ccd50>
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F3c9c48a5dff84ba3973f35dd3e24b09d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/10.jpg saved to cache
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b45ee0fe-0bda-5382-a96b-95465e7f768d
2026-03-24 22:55:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b45ee0fe-0bda-5382-a96b-95465e7f768d, skipping ID generation
2026-03-24 22:55:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b45ee0fe-0bda-5382-a96b-95465e7f768d with scrape type 1
2026-03-24 22:55:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b45ee0fe-0bda-5382-a96b-95465e7f768d sending to next pipeline
2026-03-24 22:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b45ee0fe-0bda-5382-a96b-95465e7f768d, identifier: 1980464
2026-03-24 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b45ee0fe-0bda-5382-a96b-95465e7f768d with identifier: 1980464
2026-03-24 22:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b45ee0fe-0bda-5382-a96b-95465e7f768d with identifier: 1980464
2026-03-24 22:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b45ee0fe-0bda-5382-a96b-95465e7f768d with identifier: 1980464 to the API
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b45ee0fe-0bda-5382-a96b-95465e7f768d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI COUNTRYMAN - 2017',
 'odometer': 129294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 918123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 882935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b45ee0fe-0bda-5382-a96b-95465e7f768d/b45ee0fe-0bda-5382-a96b-95465e7f768d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/3c9c48a5dff84ba3973f35dd3e24b09d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI COUNTRYMAN - 2017 1.5A PHEV Cooper SE ALL4 (EU6d-T.)',
 'transmission': 'automatic',
 'trim': '1.5A PHEV Cooper SE ALL4 (EU6d-T.)',
 'vin': None,
 'year': 2020}
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980464%27 HTTP/1.1" 200 None
2026-03-24 22:55:28 [ayvens.be] INFO: Saving data for 1980464: {'created_time': 1774392928.903767, 'last_price_update_time': 1774392928.903776, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980464') HTTP/1.1" 204 0
2026-03-24 22:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/7.jpg not downloaded yet
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cea50>
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/10.jpg saved to cache
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967f810>
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/9.jpg saved to cache
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/8.jpg not downloaded yet
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091aeb10>
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/8.jpg saved to cache
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fa3d0>
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fv%252Fdc30ab628ff94ac2a88594ee3f61d54e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/7.jpg saved to cache
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71df9a1a-6e8c-59ec-8e46-5338df18a265
2026-03-24 22:55:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71df9a1a-6e8c-59ec-8e46-5338df18a265, skipping ID generation
2026-03-24 22:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71df9a1a-6e8c-59ec-8e46-5338df18a265 with scrape type 1
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71df9a1a-6e8c-59ec-8e46-5338df18a265 sending to next pipeline
2026-03-24 22:55:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71df9a1a-6e8c-59ec-8e46-5338df18a265, identifier: 1980465
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3d50>
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/2.jpg saved to cache
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/9.jpg not downloaded yet
2026-03-24 22:55:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71df9a1a-6e8c-59ec-8e46-5338df18a265 with identifier: 1980465
2026-03-24 22:55:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71df9a1a-6e8c-59ec-8e46-5338df18a265 with identifier: 1980465
2026-03-24 22:55:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71df9a1a-6e8c-59ec-8e46-5338df18a265 with identifier: 1980465 to the API
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 6,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '71df9a1a-6e8c-59ec-8e46-5338df18a265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE FOURGON MWB DSL - 2016',
 'odometer': 134017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71df9a1a-6e8c-59ec-8e46-5338df18a265/71df9a1a-6e8c-59ec-8e46-5338df18a265_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fv/dc30ab628ff94ac2a88594ee3f61d54e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE FOURGON MWB DSL - 2016 2.0 D-4D Long Comfort S&S',
 'transmission': 'manual',
 'trim': '2.0 D-4D Long Comfort S&S',
 'vin': None,
 'year': 2019}
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980465%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [ayvens.be] INFO: Saving data for 1980465: {'created_time': 1774392930.116465, 'last_price_update_time': 1774392930.116475, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980465') HTTP/1.1" 204 0
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b2ca2d0>
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/1.jpg saved to cache
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/10.jpg not downloaded yet
2026-03-24 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009686bd0>
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/4.jpg saved to cache
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009dae150>
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/3.jpg saved to cache
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:30 [ayvens.be] INFO: Found listing with ID: 1980467
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980467%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [ayvens.be] INFO: Scrape type for 1980467: 1
2026-03-24 22:55:30 [ayvens.be] INFO: Extracting data for car ID: 1980467
2026-03-24 22:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3870caa4-fc79-50fc-a1f5-7341811b5da7 with identifier: 1980467
2026-03-24 22:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3870caa4-fc79-50fc-a1f5-7341811b5da7 with scrape type 1
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/1.jpg not downloaded yet
2026-03-24 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/2.jpg not downloaded yet
2026-03-24 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492b90>
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/5.jpg saved to cache
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/3.jpg not downloaded yet
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/4.jpg not downloaded yet
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e490>
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/6.jpg saved to cache
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835ad90>
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/7.jpg saved to cache
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/5.jpg not downloaded yet
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915c090>
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/8.jpg saved to cache
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/6.jpg not downloaded yet
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/7.jpg not downloaded yet
2026-03-24 22:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/8.jpg not downloaded yet
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442810>
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/9.jpg saved to cache
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/9.jpg not downloaded yet
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/10.jpg not downloaded yet
2026-03-24 22:55:30 [ayvens.be] INFO: Found listing with ID: 1980468
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980468%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [ayvens.be] INFO: Scrape type for 1980468: 1
2026-03-24 22:55:30 [ayvens.be] INFO: Extracting data for car ID: 1980468
2026-03-24 22:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5542c022-0c6f-5d44-8629-abc499f014b9 with identifier: 1980468
2026-03-24 22:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5542c022-0c6f-5d44-8629-abc499f014b9 with scrape type 1
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/1.jpg not downloaded yet
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913d410>
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F6922b6f837f14cbe9e47d5a77cd92ba4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/10.jpg saved to cache
2026-03-24 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d63b12f7-960e-590b-8366-26d681e2e784
2026-03-24 22:55:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d63b12f7-960e-590b-8366-26d681e2e784, skipping ID generation
2026-03-24 22:55:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63b12f7-960e-590b-8366-26d681e2e784 with scrape type 1
2026-03-24 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d63b12f7-960e-590b-8366-26d681e2e784 sending to next pipeline
2026-03-24 22:55:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d63b12f7-960e-590b-8366-26d681e2e784, identifier: 1980466
2026-03-24 22:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d63b12f7-960e-590b-8366-26d681e2e784 with identifier: 1980466
2026-03-24 22:55:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d63b12f7-960e-590b-8366-26d681e2e784 with identifier: 1980466
2026-03-24 22:55:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d63b12f7-960e-590b-8366-26d681e2e784 with identifier: 1980466 to the API
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd63b12f7-960e-590b-8366-26d681e2e784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C5 AIRCROSS',
 'odometer': 68337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d63b12f7-960e-590b-8366-26d681e2e784/d63b12f7-960e-590b-8366-26d681e2e784_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/6922b6f837f14cbe9e47d5a77cd92ba4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C5 AIRCROSS 1.6 PureTech PHEV Feel S&S',
 'transmission': 'automatic',
 'trim': '1.6 PureTech PHEV Feel S&S',
 'vin': None,
 'year': 2020}
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980466%27 HTTP/1.1" 200 None
2026-03-24 22:55:31 [ayvens.be] INFO: Saving data for 1980466: {'created_time': 1774392931.916268, 'last_price_update_time': 1774392931.916279, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980466') HTTP/1.1" 204 0
2026-03-24 22:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/2.jpg not downloaded yet
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/3.jpg not downloaded yet
2026-03-24 22:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094224d0>
2026-03-24 22:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/3.jpg saved to cache
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/4.jpg not downloaded yet
2026-03-24 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/5.jpg not downloaded yet
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335c50>
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/1.jpg saved to cache
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917c9d0>
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/2.jpg saved to cache
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/6.jpg not downloaded yet
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970f810>
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/4.jpg saved to cache
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/7.jpg not downloaded yet
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009191310>
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/6.jpg saved to cache
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/8.jpg not downloaded yet
2026-03-24 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/9.jpg not downloaded yet
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009423050>
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/5.jpg saved to cache
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/10.jpg not downloaded yet
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760190>
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/7.jpg saved to cache
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:32 [ayvens.be] INFO: Found listing with ID: 1980469
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980469%27 HTTP/1.1" 200 None
2026-03-24 22:55:32 [ayvens.be] INFO: Scrape type for 1980469: 1
2026-03-24 22:55:32 [ayvens.be] INFO: Extracting data for car ID: 1980469
2026-03-24 22:55:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1980469
2026-03-24 22:55:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ace69f-baad-5850-800a-8994805bd9da with scrape type 1
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/1.jpg not downloaded yet
2026-03-24 22:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493110>
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/8.jpg saved to cache
2026-03-24 22:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8790>
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/1.jpg saved to cache
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/2.jpg not downloaded yet
2026-03-24 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/3.jpg not downloaded yet
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175a50>
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/9.jpg saved to cache
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610f50>
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/2.jpg saved to cache
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836ab10>
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F666f5a5ec68c4b1ea7986518bd06117b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/10.jpg saved to cache
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3870caa4-fc79-50fc-a1f5-7341811b5da7
2026-03-24 22:55:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3870caa4-fc79-50fc-a1f5-7341811b5da7, skipping ID generation
2026-03-24 22:55:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3870caa4-fc79-50fc-a1f5-7341811b5da7 with scrape type 1
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3870caa4-fc79-50fc-a1f5-7341811b5da7 sending to next pipeline
2026-03-24 22:55:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3870caa4-fc79-50fc-a1f5-7341811b5da7, identifier: 1980467
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334fd0>
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/3.jpg saved to cache
2026-03-24 22:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3870caa4-fc79-50fc-a1f5-7341811b5da7 with identifier: 1980467
2026-03-24 22:55:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3870caa4-fc79-50fc-a1f5-7341811b5da7 with identifier: 1980467
2026-03-24 22:55:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3870caa4-fc79-50fc-a1f5-7341811b5da7 with identifier: 1980467 to the API
2026-03-24 22:55:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3870caa4-fc79-50fc-a1f5-7341811b5da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS CLA SHOOTING BREAK (X118',
 'odometer': 109434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3870caa4-fc79-50fc-a1f5-7341811b5da7/3870caa4-fc79-50fc-a1f5-7341811b5da7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/666f5a5ec68c4b1ea7986518bd06117b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS CLA SHOOTING BREAK (X118 CLA 180 Business '
          'Solution',
 'transmission': 'manual',
 'trim': 'CLA 180 Business Solution',
 'vin': None,
 'year': 2021}
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980467%27 HTTP/1.1" 200 None
2026-03-24 22:55:34 [ayvens.be] INFO: Saving data for 1980467: {'created_time': 1774392934.754925, 'last_price_update_time': 1774392934.754934, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980467') HTTP/1.1" 204 0
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/4.jpg not downloaded yet
2026-03-24 22:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978aa10>
2026-03-24 22:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/5.jpg saved to cache
2026-03-24 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/5.jpg not downloaded yet
2026-03-24 22:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872690>
2026-03-24 22:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/4.jpg saved to cache
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/6.jpg not downloaded yet
2026-03-24 22:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/7.jpg not downloaded yet
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/8.jpg not downloaded yet
2026-03-24 22:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/9.jpg not downloaded yet
2026-03-24 22:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/10.jpg not downloaded yet
2026-03-24 22:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:35 [ayvens.be] INFO: Found listing with ID: 1980470
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980470%27 HTTP/1.1" 200 None
2026-03-24 22:55:35 [ayvens.be] INFO: Scrape type for 1980470: 1
2026-03-24 22:55:35 [ayvens.be] INFO: Extracting data for car ID: 1980470
2026-03-24 22:55:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1980470
2026-03-24 22:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with scrape type 1
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/1.jpg not downloaded yet
2026-03-24 22:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aabd0>
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/6.jpg saved to cache
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9a10>
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/7.jpg saved to cache
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/2.jpg not downloaded yet
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ca050>
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/8.jpg saved to cache
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009873e90>
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/1.jpg saved to cache
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/3.jpg not downloaded yet
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098714d0>
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/9.jpg saved to cache
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449690>
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fdab347ee1d694e54bf2d3172a0c04f84%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/10.jpg saved to cache
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5542c022-0c6f-5d44-8629-abc499f014b9
2026-03-24 22:55:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5542c022-0c6f-5d44-8629-abc499f014b9, skipping ID generation
2026-03-24 22:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5542c022-0c6f-5d44-8629-abc499f014b9 with scrape type 1
2026-03-24 22:55:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5542c022-0c6f-5d44-8629-abc499f014b9 sending to next pipeline
2026-03-24 22:55:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5542c022-0c6f-5d44-8629-abc499f014b9, identifier: 1980468
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b2c84d0>
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/2.jpg saved to cache
2026-03-24 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613690>
2026-03-24 22:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/3.jpg saved to cache
2026-03-24 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/4.jpg not downloaded yet
2026-03-24 22:55:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5542c022-0c6f-5d44-8629-abc499f014b9 with identifier: 1980468
2026-03-24 22:55:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5542c022-0c6f-5d44-8629-abc499f014b9 with identifier: 1980468
2026-03-24 22:55:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5542c022-0c6f-5d44-8629-abc499f014b9 with identifier: 1980468 to the API
2026-03-24 22:55:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '5542c022-0c6f-5d44-8629-abc499f014b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 171531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 923300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5542c022-0c6f-5d44-8629-abc499f014b9/5542c022-0c6f-5d44-8629-abc499f014b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 833062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/dab347ee1d694e54bf2d3172a0c04f84/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980468%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [ayvens.be] INFO: Saving data for 1980468: {'created_time': 1774392937.436729, 'last_price_update_time': 1774392937.436741, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980468') HTTP/1.1" 204 0
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/5.jpg not downloaded yet
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/6.jpg not downloaded yet
2026-03-24 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/7.jpg not downloaded yet
2026-03-24 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/8.jpg not downloaded yet
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/9.jpg not downloaded yet
2026-03-24 22:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/10.jpg not downloaded yet
2026-03-24 22:55:37 [ayvens.be] INFO: Found listing with ID: 1980471
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980471%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [ayvens.be] INFO: Scrape type for 1980471: 1
2026-03-24 22:55:37 [ayvens.be] INFO: Extracting data for car ID: 1980471
2026-03-24 22:55:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1980471
2026-03-24 22:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95e3aae-a4af-5899-ae14-85507159c18e with scrape type 1
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/1.jpg not downloaded yet
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/2.jpg not downloaded yet
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916c7d0>
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/7.jpg saved to cache
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916cc10>
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/1.jpg saved to cache
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1bb850>
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/2.jpg saved to cache
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/3.jpg not downloaded yet
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94c50>
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/6.jpg saved to cache
2026-03-24 22:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095651d0>
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/8.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911b510>
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/5.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009565310>
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/4.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/4.jpg not downloaded yet
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009719010>
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/10.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/5.jpg not downloaded yet
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/6.jpg not downloaded yet
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187a50>
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/6.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310a90>
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/4.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fa750>
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/5.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/7.jpg not downloaded yet
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/8.jpg not downloaded yet
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2150>
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/3.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009013b10>
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/7.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0cd0>
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/8.jpg saved to cache
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/9.jpg not downloaded yet
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/10.jpg not downloaded yet
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [ayvens.be] INFO: Found listing with ID: 1980472
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980472%27 HTTP/1.1" 200 None
2026-03-24 22:55:38 [ayvens.be] INFO: Scrape type for 1980472: 1
2026-03-24 22:55:38 [ayvens.be] INFO: Extracting data for car ID: 1980472
2026-03-24 22:55:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1980472
2026-03-24 22:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fbcad31-cd3d-5d96-a553-22221415efe3 with scrape type 1
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/1.jpg not downloaded yet
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/2.jpg not downloaded yet
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/3.jpg not downloaded yet
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/4.jpg not downloaded yet
2026-03-24 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008312990>
2026-03-24 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fcbe3dcdaae3245e7a4099a19bac8eefa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/9.jpg saved to cache
2026-03-24 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86ace69f-baad-5850-800a-8994805bd9da
2026-03-24 22:55:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86ace69f-baad-5850-800a-8994805bd9da, skipping ID generation
2026-03-24 22:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ace69f-baad-5850-800a-8994805bd9da with scrape type 1
2026-03-24 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86ace69f-baad-5850-800a-8994805bd9da sending to next pipeline
2026-03-24 22:55:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86ace69f-baad-5850-800a-8994805bd9da, identifier: 1980469
2026-03-24 22:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d2150>
2026-03-24 22:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/10.jpg saved to cache
2026-03-24 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/5.jpg not downloaded yet
2026-03-24 22:55:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1980469
2026-03-24 22:55:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1980469
2026-03-24 22:55:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86ace69f-baad-5850-800a-8994805bd9da with identifier: 1980469 to the API
2026-03-24 22:55:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '86ace69f-baad-5850-800a-8994805bd9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 122499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86ace69f-baad-5850-800a-8994805bd9da/86ace69f-baad-5850-800a-8994805bd9da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/cbe3dcdaae3245e7a4099a19bac8eefa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2021}
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980469%27 HTTP/1.1" 200 None
2026-03-24 22:55:40 [ayvens.be] INFO: Saving data for 1980469: {'created_time': 1774392940.682946, 'last_price_update_time': 1774392940.682955, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980469') HTTP/1.1" 204 0
2026-03-24 22:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8250>
2026-03-24 22:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F5c8f1122ba46435f902bca8f61e2fc34%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/9.jpg saved to cache
2026-03-24 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419
2026-03-24 22:55:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419, skipping ID generation
2026-03-24 22:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with scrape type 1
2026-03-24 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 sending to next pipeline
2026-03-24 22:55:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419, identifier: 1980470
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/6.jpg not downloaded yet
2026-03-24 22:55:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1980470
2026-03-24 22:55:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1980470
2026-03-24 22:55:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 13cb0d5c-a1ec-528d-8bd3-8c2a28f16419 with identifier: 1980470 to the API
2026-03-24 22:55:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '13cb0d5c-a1ec-528d-8bd3-8c2a28f16419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 70990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cb0d5c-a1ec-528d-8bd3-8c2a28f16419/13cb0d5c-a1ec-528d-8bd3-8c2a28f16419_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/5c8f1122ba46435f902bca8f61e2fc34/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROËN GRAND C4 SPACETOURER 1.2 PURETECH 130 S-S SHINE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 S-S SHINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980470%27 HTTP/1.1" 200 None
2026-03-24 22:55:42 [ayvens.be] INFO: Saving data for 1980470: {'created_time': 1774392942.157539, 'last_price_update_time': 1774392942.15755, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980470') HTTP/1.1" 204 0
2026-03-24 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/7.jpg not downloaded yet
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2d10>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/3.jpg saved to cache
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834ef90>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/2.jpg saved to cache
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945b350>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/1.jpg saved to cache
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834c310>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/4.jpg saved to cache
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336650>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/5.jpg saved to cache
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/8.jpg not downloaded yet
2026-03-24 22:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910fc90>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/8.jpg saved to cache
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913cd50>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/1.jpg saved to cache
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916f010>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/2.jpg saved to cache
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/9.jpg not downloaded yet
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/10.jpg not downloaded yet
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a1a90>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/7.jpg saved to cache
2026-03-24 22:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910c3d0>
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/10.jpg saved to cache
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963a110>
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/9.jpg saved to cache
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ca990>
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/3.jpg saved to cache
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3e90>
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F1cfa31a7d2e842708a0feb3e9c8134da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/6.jpg saved to cache
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f95e3aae-a4af-5899-ae14-85507159c18e
2026-03-24 22:55:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f95e3aae-a4af-5899-ae14-85507159c18e, skipping ID generation
2026-03-24 22:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95e3aae-a4af-5899-ae14-85507159c18e with scrape type 1
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f95e3aae-a4af-5899-ae14-85507159c18e sending to next pipeline
2026-03-24 22:55:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f95e3aae-a4af-5899-ae14-85507159c18e, identifier: 1980471
2026-03-24 22:55:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1980471
2026-03-24 22:55:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1980471
2026-03-24 22:55:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f95e3aae-a4af-5899-ae14-85507159c18e with identifier: 1980471 to the API
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f95e3aae-a4af-5899-ae14-85507159c18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 43732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e3aae-a4af-5899-ae14-85507159c18e/f95e3aae-a4af-5899-ae14-85507159c18e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/1cfa31a7d2e842708a0feb3e9c8134da/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 520E AUTO',
 'transmission': 'automatic',
 'trim': '2.0 520E AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980471%27 HTTP/1.1" 200 None
2026-03-24 22:55:43 [ayvens.be] INFO: Saving data for 1980471: {'created_time': 1774392943.629625, 'last_price_update_time': 1774392943.629634, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980471') HTTP/1.1" 204 0
2026-03-24 22:55:43 [ayvens.be] INFO: Found listing with ID: 1980473
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980473%27 HTTP/1.1" 200 None
2026-03-24 22:55:43 [ayvens.be] INFO: Scrape type for 1980473: 1
2026-03-24 22:55:43 [ayvens.be] INFO: Extracting data for car ID: 1980473
2026-03-24 22:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1980473
2026-03-24 22:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68f2489-e4bd-53cf-9df3-8a995c530188 with scrape type 1
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/1.jpg not downloaded yet
2026-03-24 22:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/2.jpg not downloaded yet
2026-03-24 22:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/3.jpg not downloaded yet
2026-03-24 22:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/4.jpg not downloaded yet
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/5.jpg not downloaded yet
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fa990>
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/4.jpg saved to cache
2026-03-24 22:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cc190>
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/6.jpg saved to cache
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/6.jpg not downloaded yet
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/7.jpg not downloaded yet
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083cb790>
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/5.jpg saved to cache
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c810>
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/7.jpg saved to cache
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b7d0>
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/8.jpg saved to cache
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/8.jpg not downloaded yet
2026-03-24 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009789cd0>
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/9.jpg saved to cache
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/9.jpg not downloaded yet
2026-03-24 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/10.jpg not downloaded yet
2026-03-24 22:55:44 [ayvens.be] INFO: Found listing with ID: 1980474
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980474%27 HTTP/1.1" 200 None
2026-03-24 22:55:44 [ayvens.be] INFO: Scrape type for 1980474: 1
2026-03-24 22:55:44 [ayvens.be] INFO: Extracting data for car ID: 1980474
2026-03-24 22:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1980474
2026-03-24 22:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with scrape type 1
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/1.jpg not downloaded yet
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/2.jpg not downloaded yet
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b5850>
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/2.jpg saved to cache
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b2d0>
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fad96377a053449929d9f7a05cc764326%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/10.jpg saved to cache
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6fbcad31-cd3d-5d96-a553-22221415efe3
2026-03-24 22:55:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fbcad31-cd3d-5d96-a553-22221415efe3, skipping ID generation
2026-03-24 22:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fbcad31-cd3d-5d96-a553-22221415efe3 with scrape type 1
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fbcad31-cd3d-5d96-a553-22221415efe3 sending to next pipeline
2026-03-24 22:55:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6fbcad31-cd3d-5d96-a553-22221415efe3, identifier: 1980472
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeafc10>
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/1.jpg saved to cache
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/3.jpg not downloaded yet
2026-03-24 22:55:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1980472
2026-03-24 22:55:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1980472
2026-03-24 22:55:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6fbcad31-cd3d-5d96-a553-22221415efe3 with identifier: 1980472 to the API
2026-03-24 22:55:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6fbcad31-cd3d-5d96-a553-22221415efe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'Santa Fe',
 'odometer': 122389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fbcad31-cd3d-5d96-a553-22221415efe3/6fbcad31-cd3d-5d96-a553-22221415efe3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ad96377a053449929d9f7a05cc764326/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI Santa Fe 1.6 T-GDI PHEV 4WD SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI PHEV 4WD SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980472%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [ayvens.be] INFO: Saving data for 1980472: {'created_time': 1774392945.118567, 'last_price_update_time': 1774392945.118577, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980472') HTTP/1.1" 204 0
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/4.jpg not downloaded yet
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910cf90>
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/3.jpg saved to cache
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a3690>
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/5.jpg saved to cache
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3110>
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/4.jpg saved to cache
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/5.jpg not downloaded yet
2026-03-24 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/6.jpg not downloaded yet
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/7.jpg not downloaded yet
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/8.jpg not downloaded yet
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/9.jpg not downloaded yet
2026-03-24 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/10.jpg not downloaded yet
2026-03-24 22:55:45 [ayvens.be] INFO: Found listing with ID: 1980475
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980475%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [ayvens.be] INFO: Scrape type for 1980475: 1
2026-03-24 22:55:45 [ayvens.be] INFO: Extracting data for car ID: 1980475
2026-03-24 22:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1980475
2026-03-24 22:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a with scrape type 1
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/1.jpg not downloaded yet
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28790>
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/8.jpg saved to cache
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/2.jpg not downloaded yet
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/3.jpg not downloaded yet
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910e910>
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/6.jpg saved to cache
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c3450>
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/7.jpg saved to cache
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091751d0>
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/9.jpg saved to cache
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564610>
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5b4dc1288b1c45f8b6e027ea8fd91cfe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/10.jpg saved to cache
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b68f2489-e4bd-53cf-9df3-8a995c530188
2026-03-24 22:55:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b68f2489-e4bd-53cf-9df3-8a995c530188, skipping ID generation
2026-03-24 22:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68f2489-e4bd-53cf-9df3-8a995c530188 with scrape type 1
2026-03-24 22:55:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b68f2489-e4bd-53cf-9df3-8a995c530188 sending to next pipeline
2026-03-24 22:55:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b68f2489-e4bd-53cf-9df3-8a995c530188, identifier: 1980473
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913d990>
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/2.jpg saved to cache
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382d50>
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/1.jpg saved to cache
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1980473
2026-03-24 22:55:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1980473
2026-03-24 22:55:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b68f2489-e4bd-53cf-9df3-8a995c530188 with identifier: 1980473 to the API
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b68f2489-e4bd-53cf-9df3-8a995c530188',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 73595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b68f2489-e4bd-53cf-9df3-8a995c530188/b68f2489-e4bd-53cf-9df3-8a995c530188_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5b4dc1288b1c45f8b6e027ea8fd91cfe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216D ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216D ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980473%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [ayvens.be] INFO: Saving data for 1980473: {'created_time': 1774392946.539184, 'last_price_update_time': 1774392946.539194, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980473') HTTP/1.1" 204 0
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/4.jpg not downloaded yet
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/5.jpg not downloaded yet
2026-03-24 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/6.jpg not downloaded yet
2026-03-24 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/7.jpg not downloaded yet
2026-03-24 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/8.jpg not downloaded yet
2026-03-24 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/9.jpg not downloaded yet
2026-03-24 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/10.jpg not downloaded yet
2026-03-24 22:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:46 [ayvens.be] INFO: Found listing with ID: 1980476
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980476%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [ayvens.be] INFO: Scrape type for 1980476: 1
2026-03-24 22:55:46 [ayvens.be] INFO: Extracting data for car ID: 1980476
2026-03-24 22:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09858042-af1c-5045-843b-0c8ae2be13f9 with identifier: 1980476
2026-03-24 22:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09858042-af1c-5045-843b-0c8ae2be13f9 with scrape type 1
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/1.jpg not downloaded yet
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d44d0>
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/4.jpg saved to cache
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c9450>
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/3.jpg saved to cache
2026-03-24 22:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/2.jpg not downloaded yet
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a96d0>
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/5.jpg saved to cache
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8450>
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/6.jpg saved to cache
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/3.jpg not downloaded yet
2026-03-24 22:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/4.jpg not downloaded yet
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406a10>
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/9.jpg saved to cache
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915d2d0>
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/7.jpg saved to cache
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945cf50>
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/10.jpg saved to cache
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382e90>
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F3bad3c54fbb64f8d921c667eaae6202d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/8.jpg saved to cache
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6
2026-03-24 22:55:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6, skipping ID generation
2026-03-24 22:55:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with scrape type 1
2026-03-24 22:55:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 sending to next pipeline
2026-03-24 22:55:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6, identifier: 1980474
2026-03-24 22:55:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1980474
2026-03-24 22:55:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1980474
2026-03-24 22:55:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4ce88cda-37cc-5ed6-9dc9-8eef121d5db6 with identifier: 1980474 to the API
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4ce88cda-37cc-5ed6-9dc9-8eef121d5db6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 151110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 850566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ce88cda-37cc-5ed6-9dc9-8eef121d5db6/4ce88cda-37cc-5ed6-9dc9-8eef121d5db6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/3bad3c54fbb64f8d921c667eaae6202d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI MHEV 81KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.0 TSI MHEV 81KW DSG CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980474%27 HTTP/1.1" 200 None
2026-03-24 22:55:47 [ayvens.be] INFO: Saving data for 1980474: {'created_time': 1774392947.966792, 'last_price_update_time': 1774392947.966801, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980474') HTTP/1.1" 204 0
2026-03-24 22:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/5.jpg not downloaded yet
2026-03-24 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/6.jpg not downloaded yet
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94590>
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/1.jpg saved to cache
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/7.jpg not downloaded yet
2026-03-24 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/8.jpg not downloaded yet
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009862910>
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/2.jpg saved to cache
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913f0d0>
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/3.jpg saved to cache
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/9.jpg not downloaded yet
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/10.jpg not downloaded yet
2026-03-24 22:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641450>
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/4.jpg saved to cache
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2590>
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/7.jpg saved to cache
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009763e10>
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/5.jpg saved to cache
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009701290>
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/6.jpg saved to cache
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:48 [ayvens.be] INFO: Found listing with ID: 1980477
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980477%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [ayvens.be] INFO: Scrape type for 1980477: 1
2026-03-24 22:55:48 [ayvens.be] INFO: Extracting data for car ID: 1980477
2026-03-24 22:55:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd00884-726f-5fb7-acaa-5d76390baede with identifier: 1980477
2026-03-24 22:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd00884-726f-5fb7-acaa-5d76390baede with scrape type 1
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/1.jpg not downloaded yet
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/2.jpg not downloaded yet
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/3.jpg not downloaded yet
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836b990>
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/8.jpg saved to cache
2026-03-24 22:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091e2e10>
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/2.jpg saved to cache
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/4.jpg not downloaded yet
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/5.jpg not downloaded yet
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/6.jpg not downloaded yet
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/7.jpg not downloaded yet
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/8.jpg not downloaded yet
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/9.jpg not downloaded yet
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/10.jpg not downloaded yet
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008373090>
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/9.jpg saved to cache
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce050>
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/1.jpg saved to cache
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:49 [ayvens.be] INFO: Found listing with ID: 1980478
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980478%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [ayvens.be] INFO: Scrape type for 1980478: 1
2026-03-24 22:55:49 [ayvens.be] INFO: Extracting data for car ID: 1980478
2026-03-24 22:55:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b59445-e654-592a-ad8a-689c6e0c1bad with identifier: 1980478
2026-03-24 22:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b59445-e654-592a-ad8a-689c6e0c1bad with scrape type 1
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/1.jpg not downloaded yet
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911e890>
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F45a68fc5f08743b782ba20689211464e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/10.jpg saved to cache
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a
2026-03-24 22:55:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e6ba21e-49be-57d2-b325-bc6c4433d37a, skipping ID generation
2026-03-24 22:55:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a with scrape type 1
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e6ba21e-49be-57d2-b325-bc6c4433d37a sending to next pipeline
2026-03-24 22:55:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3e6ba21e-49be-57d2-b325-bc6c4433d37a, identifier: 1980475
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/2.jpg not downloaded yet
2026-03-24 22:55:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1980475
2026-03-24 22:55:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1980475
2026-03-24 22:55:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3e6ba21e-49be-57d2-b325-bc6c4433d37a with identifier: 1980475 to the API
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3e6ba21e-49be-57d2-b325-bc6c4433d37a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 102886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6ba21e-49be-57d2-b325-bc6c4433d37a/3e6ba21e-49be-57d2-b325-bc6c4433d37a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/45a68fc5f08743b782ba20689211464e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980475%27 HTTP/1.1" 200 None
2026-03-24 22:55:50 [ayvens.be] INFO: Saving data for 1980475: {'created_time': 1774392950.070126, 'last_price_update_time': 1774392950.070136, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980475') HTTP/1.1" 204 0
2026-03-24 22:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/3.jpg not downloaded yet
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008342bd0>
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/3.jpg saved to cache
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009566350>
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/5.jpg saved to cache
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009567ed0>
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/4.jpg saved to cache
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a3fd0>
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/6.jpg saved to cache
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639f90>
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/7.jpg saved to cache
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/4.jpg not downloaded yet
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b58d0>
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/5.jpg saved to cache
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c110>
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/2.jpg saved to cache
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/5.jpg not downloaded yet
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441b10>
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/3.jpg saved to cache
2026-03-24 22:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cc050>
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/1.jpg saved to cache
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009142b90>
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/4.jpg saved to cache
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d03790>
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/10.jpg saved to cache
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/6.jpg not downloaded yet
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/7.jpg not downloaded yet
2026-03-24 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/8.jpg not downloaded yet
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309b10>
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/9.jpg saved to cache
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1e10>
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F73f50d7fb714424ca950befe9aee0b00%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/8.jpg saved to cache
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09858042-af1c-5045-843b-0c8ae2be13f9
2026-03-24 22:55:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09858042-af1c-5045-843b-0c8ae2be13f9, skipping ID generation
2026-03-24 22:55:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09858042-af1c-5045-843b-0c8ae2be13f9 with scrape type 1
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09858042-af1c-5045-843b-0c8ae2be13f9 sending to next pipeline
2026-03-24 22:55:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09858042-af1c-5045-843b-0c8ae2be13f9, identifier: 1980476
2026-03-24 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09858042-af1c-5045-843b-0c8ae2be13f9 with identifier: 1980476
2026-03-24 22:55:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09858042-af1c-5045-843b-0c8ae2be13f9 with identifier: 1980476
2026-03-24 22:55:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09858042-af1c-5045-843b-0c8ae2be13f9 with identifier: 1980476 to the API
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '09858042-af1c-5045-843b-0c8ae2be13f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2-serie',
 'odometer': 112080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 889230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09858042-af1c-5045-843b-0c8ae2be13f9/09858042-af1c-5045-843b-0c8ae2be13f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/73f50d7fb714424ca950befe9aee0b00/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2-serie 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980476%27 HTTP/1.1" 200 None
2026-03-24 22:55:51 [ayvens.be] INFO: Saving data for 1980476: {'created_time': 1774392951.807755, 'last_price_update_time': 1774392951.807764, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980476') HTTP/1.1" 204 0
2026-03-24 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/9.jpg not downloaded yet
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/10.jpg not downloaded yet
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb2190>
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/6.jpg saved to cache
2026-03-24 22:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cd2d0>
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/7.jpg saved to cache
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bff90>
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/10.jpg saved to cache
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:52 [ayvens.be] INFO: Found listing with ID: 1980479
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980479%27 HTTP/1.1" 200 None
2026-03-24 22:55:52 [ayvens.be] INFO: Scrape type for 1980479: 1
2026-03-24 22:55:52 [ayvens.be] INFO: Extracting data for car ID: 1980479
2026-03-24 22:55:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with identifier: 1980479
2026-03-24 22:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with scrape type 1
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/1.jpg not downloaded yet
2026-03-24 22:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/2.jpg not downloaded yet
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916f350>
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/8.jpg saved to cache
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009140d10>
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4159f4bf09d84ba59403fe02d6bbf60c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/9.jpg saved to cache
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cd00884-726f-5fb7-acaa-5d76390baede
2026-03-24 22:55:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cd00884-726f-5fb7-acaa-5d76390baede, skipping ID generation
2026-03-24 22:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd00884-726f-5fb7-acaa-5d76390baede with scrape type 1
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cd00884-726f-5fb7-acaa-5d76390baede sending to next pipeline
2026-03-24 22:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6cd00884-726f-5fb7-acaa-5d76390baede, identifier: 1980477
2026-03-24 22:55:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6cd00884-726f-5fb7-acaa-5d76390baede with identifier: 1980477
2026-03-24 22:55:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6cd00884-726f-5fb7-acaa-5d76390baede with identifier: 1980477
2026-03-24 22:55:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6cd00884-726f-5fb7-acaa-5d76390baede with identifier: 1980477 to the API
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6cd00884-726f-5fb7-acaa-5d76390baede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 131568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd00884-726f-5fb7-acaa-5d76390baede/6cd00884-726f-5fb7-acaa-5d76390baede_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4159f4bf09d84ba59403fe02d6bbf60c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980477%27 HTTP/1.1" 200 None
2026-03-24 22:55:52 [ayvens.be] INFO: Saving data for 1980477: {'created_time': 1774392952.912578, 'last_price_update_time': 1774392952.912588, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980477') HTTP/1.1" 204 0
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/3.jpg not downloaded yet
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009143e50>
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/3.jpg saved to cache
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb0050>
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/1.jpg saved to cache
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835b110>
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/2.jpg saved to cache
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/4.jpg not downloaded yet
2026-03-24 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/5.jpg not downloaded yet
2026-03-24 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/6.jpg not downloaded yet
2026-03-24 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/7.jpg not downloaded yet
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ce3d0>
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/4.jpg saved to cache
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/8.jpg not downloaded yet
2026-03-24 22:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/9.jpg not downloaded yet
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343c50>
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/6.jpg saved to cache
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338810>
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/5.jpg saved to cache
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009642bd0>
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/7.jpg saved to cache
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a08d0>
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/8.jpg saved to cache
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/10.jpg not downloaded yet
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963b790>
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/9.jpg saved to cache
2026-03-24 22:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1550>
2026-03-24 22:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fb1767ba7df78411ca51886315da8c464%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/10.jpg saved to cache
2026-03-24 22:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58b59445-e654-592a-ad8a-689c6e0c1bad
2026-03-24 22:55:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58b59445-e654-592a-ad8a-689c6e0c1bad, skipping ID generation
2026-03-24 22:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b59445-e654-592a-ad8a-689c6e0c1bad with scrape type 1
2026-03-24 22:55:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58b59445-e654-592a-ad8a-689c6e0c1bad sending to next pipeline
2026-03-24 22:55:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 58b59445-e654-592a-ad8a-689c6e0c1bad, identifier: 1980478
2026-03-24 22:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bcdfed0>
2026-03-24 22:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/1.jpg saved to cache
2026-03-24 22:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:54 [ayvens.be] INFO: Found listing with ID: 1980480
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980480%27 HTTP/1.1" 200 None
2026-03-24 22:55:54 [ayvens.be] INFO: Scrape type for 1980480: 1
2026-03-24 22:55:54 [ayvens.be] INFO: Extracting data for car ID: 1980480
2026-03-24 22:55:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651317bf-da71-5928-93a9-8df683ca4d4f with identifier: 1980480
2026-03-24 22:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651317bf-da71-5928-93a9-8df683ca4d4f with scrape type 1
2026-03-24 22:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/1.jpg not downloaded yet
2026-03-24 22:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 58b59445-e654-592a-ad8a-689c6e0c1bad with identifier: 1980478
2026-03-24 22:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 58b59445-e654-592a-ad8a-689c6e0c1bad with identifier: 1980478
2026-03-24 22:55:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 58b59445-e654-592a-ad8a-689c6e0c1bad with identifier: 1980478 to the API
2026-03-24 22:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '58b59445-e654-592a-ad8a-689c6e0c1bad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 101820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b59445-e654-592a-ad8a-689c6e0c1bad/58b59445-e654-592a-ad8a-689c6e0c1bad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/b1767ba7df78411ca51886315da8c464/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980478%27 HTTP/1.1" 200 None
2026-03-24 22:55:55 [ayvens.be] INFO: Saving data for 1980478: {'created_time': 1774392955.71123, 'last_price_update_time': 1774392955.711242, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980478') HTTP/1.1" 204 0
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/2.jpg not downloaded yet
2026-03-24 22:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/3.jpg not downloaded yet
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917ca50>
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/2.jpg saved to cache
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/4.jpg not downloaded yet
2026-03-24 22:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/5.jpg not downloaded yet
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c46d0>
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/4.jpg saved to cache
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/6.jpg not downloaded yet
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/7.jpg not downloaded yet
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cfbd0>
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/5.jpg saved to cache
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/8.jpg not downloaded yet
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911d950>
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/7.jpg saved to cache
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009863a90>
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/3.jpg saved to cache
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b27e250>
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/6.jpg saved to cache
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/9.jpg not downloaded yet
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/10.jpg not downloaded yet
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009467e10>
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/8.jpg saved to cache
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009763990>
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/10.jpg saved to cache
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:56 [ayvens.be] INFO: Found listing with ID: 1980481
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980481%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [ayvens.be] INFO: Scrape type for 1980481: 1
2026-03-24 22:55:56 [ayvens.be] INFO: Extracting data for car ID: 1980481
2026-03-24 22:55:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f07f567-8437-5fba-a342-a04349f88e38 with identifier: 1980481
2026-03-24 22:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f07f567-8437-5fba-a342-a04349f88e38 with scrape type 1
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/1.jpg not downloaded yet
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/2.jpg not downloaded yet
2026-03-24 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/3.jpg not downloaded yet
2026-03-24 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/4.jpg not downloaded yet
2026-03-24 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/5.jpg not downloaded yet
2026-03-24 22:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/6.jpg not downloaded yet
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685650>
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ec%252Fc4e5374aaaa940789431db0d5f82bd62%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/9.jpg saved to cache
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924
2026-03-24 22:55:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924, skipping ID generation
2026-03-24 22:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with scrape type 1
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 sending to next pipeline
2026-03-24 22:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924, identifier: 1980479
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6e02d0>
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/1.jpg saved to cache
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/7.jpg not downloaded yet
2026-03-24 22:55:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with identifier: 1980479
2026-03-24 22:55:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with identifier: 1980479
2026-03-24 22:55:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1c9b0a89-eb14-5060-bb05-ef2d70ce6924 with identifier: 1980479 to the API
2026-03-24 22:55:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '1c9b0a89-eb14-5060-bb05-ef2d70ce6924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 84469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c9b0a89-eb14-5060-bb05-ef2d70ce6924/1c9b0a89-eb14-5060-bb05-ef2d70ce6924_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ec/c4e5374aaaa940789431db0d5f82bd62/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BEV 50KWH ELECTR. E-208 AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH ELECTR. E-208 AUTO ALLURE PACK',
 'vin': None,
 'year': 2023}
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980479%27 HTTP/1.1" 200 None
2026-03-24 22:55:57 [ayvens.be] INFO: Saving data for 1980479: {'created_time': 1774392957.227376, 'last_price_update_time': 1774392957.227386, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980479') HTTP/1.1" 204 0
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/8.jpg not downloaded yet
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bb250>
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/2.jpg saved to cache
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613790>
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/3.jpg saved to cache
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009719c50>
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/4.jpg saved to cache
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382f10>
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/6.jpg saved to cache
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009010110>
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/5.jpg saved to cache
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009665350>
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/7.jpg saved to cache
2026-03-24 22:55:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/9.jpg not downloaded yet
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/10.jpg not downloaded yet
2026-03-24 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:58 [ayvens.be] INFO: Found listing with ID: 1980482
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980482%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [ayvens.be] INFO: Scrape type for 1980482: 1
2026-03-24 22:55:58 [ayvens.be] INFO: Extracting data for car ID: 1980482
2026-03-24 22:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f63b011-6860-565a-b21b-4983970a2e6c with identifier: 1980482
2026-03-24 22:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f63b011-6860-565a-b21b-4983970a2e6c with scrape type 1
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/1.jpg not downloaded yet
2026-03-24 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/2.jpg not downloaded yet
2026-03-24 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/3.jpg not downloaded yet
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/4.jpg not downloaded yet
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/5.jpg not downloaded yet
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1750>
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/9.jpg saved to cache
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/6.jpg not downloaded yet
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/7.jpg not downloaded yet
2026-03-24 22:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913d3d0>
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/10.jpg saved to cache
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970d950>
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/1.jpg saved to cache
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008383250>
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/2.jpg saved to cache
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970c610>
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/3.jpg saved to cache
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945b0d0>
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fe45c633d37454fe38c9daa40efb38a4c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/8.jpg saved to cache
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 651317bf-da71-5928-93a9-8df683ca4d4f
2026-03-24 22:55:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 651317bf-da71-5928-93a9-8df683ca4d4f, skipping ID generation
2026-03-24 22:55:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651317bf-da71-5928-93a9-8df683ca4d4f with scrape type 1
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 651317bf-da71-5928-93a9-8df683ca4d4f sending to next pipeline
2026-03-24 22:55:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 651317bf-da71-5928-93a9-8df683ca4d4f, identifier: 1980480
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f9a50>
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/4.jpg saved to cache
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/8.jpg not downloaded yet
2026-03-24 22:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 651317bf-da71-5928-93a9-8df683ca4d4f with identifier: 1980480
2026-03-24 22:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 651317bf-da71-5928-93a9-8df683ca4d4f with identifier: 1980480
2026-03-24 22:55:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 651317bf-da71-5928-93a9-8df683ca4d4f with identifier: 1980480 to the API
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '651317bf-da71-5928-93a9-8df683ca4d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 157154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_651317bf-da71-5928-93a9-8df683ca4d4f/651317bf-da71-5928-93a9-8df683ca4d4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/e45c633d37454fe38c9daa40efb38a4c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.5 TSI ACT 110KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT 110KW DSG7 CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980480%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [ayvens.be] INFO: Saving data for 1980480: {'created_time': 1774392959.254081, 'last_price_update_time': 1774392959.25409, 'auction_closing_time': 1774530000.0}
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980480') HTTP/1.1" 204 0
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/9.jpg not downloaded yet
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/10.jpg not downloaded yet
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095646d0>
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/7.jpg saved to cache
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:59 [ayvens.be] INFO: Found listing with ID: 1980483
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980483%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [ayvens.be] INFO: Scrape type for 1980483: 1
2026-03-24 22:55:59 [ayvens.be] INFO: Extracting data for car ID: 1980483
2026-03-24 22:55:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4acde836-8759-5802-85f5-e7e4c5e1beca with identifier: 1980483
2026-03-24 22:55:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acde836-8759-5802-85f5-e7e4c5e1beca with scrape type 1
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/1.jpg not downloaded yet
2026-03-24 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/2.jpg not downloaded yet
2026-03-24 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/3.jpg not downloaded yet
2026-03-24 22:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/4.jpg not downloaded yet
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/5.jpg not downloaded yet
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/6.jpg not downloaded yet
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422890>
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/5.jpg saved to cache
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/7.jpg not downloaded yet
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/8.jpg not downloaded yet
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/9.jpg not downloaded yet
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449990>
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/9.jpg saved to cache
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bcf90>
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/8.jpg saved to cache
2026-03-24 22:55:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083155d0>
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:55:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/10.jpg saved to cache
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bffd0>
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dr%252Fb5980769fa8247f3a33097ab0b7f937e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/6.jpg saved to cache
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f07f567-8437-5fba-a342-a04349f88e38
2026-03-24 22:56:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f07f567-8437-5fba-a342-a04349f88e38, skipping ID generation
2026-03-24 22:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f07f567-8437-5fba-a342-a04349f88e38 with scrape type 1
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f07f567-8437-5fba-a342-a04349f88e38 sending to next pipeline
2026-03-24 22:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f07f567-8437-5fba-a342-a04349f88e38, identifier: 1980481
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945cd50>
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/1.jpg saved to cache
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112c10>
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/5.jpg saved to cache
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009420490>
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/6.jpg saved to cache
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f07f567-8437-5fba-a342-a04349f88e38 with identifier: 1980481
2026-03-24 22:56:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f07f567-8437-5fba-a342-a04349f88e38 with identifier: 1980481
2026-03-24 22:56:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f07f567-8437-5fba-a342-a04349f88e38 with identifier: 1980481 to the API
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '9f07f567-8437-5fba-a342-a04349f88e38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 30338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 783397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f07f567-8437-5fba-a342-a04349f88e38/9f07f567-8437-5fba-a342-a04349f88e38_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dr/b5980769fa8247f3a33097ab0b7f937e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2023}
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980481%27 HTTP/1.1" 200 None
2026-03-24 22:56:00 [ayvens.be] INFO: Saving data for 1980481: {'created_time': 1774392960.782769, 'last_price_update_time': 1774392960.782778, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980481') HTTP/1.1" 204 0
2026-03-24 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/10.jpg not downloaded yet
2026-03-24 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:00 [ayvens.be] INFO: Found listing with ID: 1980484
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980484%27 HTTP/1.1" 200 None
2026-03-24 22:56:00 [ayvens.be] INFO: Scrape type for 1980484: 1
2026-03-24 22:56:00 [ayvens.be] INFO: Extracting data for car ID: 1980484
2026-03-24 22:56:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4663043-cff4-5c88-8a1a-8bd891f8805c with identifier: 1980484
2026-03-24 22:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4663043-cff4-5c88-8a1a-8bd891f8805c with scrape type 1
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/1.jpg not downloaded yet
2026-03-24 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008324f90>
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/2.jpg saved to cache
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/2.jpg not downloaded yet
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/3.jpg not downloaded yet
2026-03-24 22:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/4.jpg not downloaded yet
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009762990>
2026-03-24 22:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/1.jpg saved to cache
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bcd50>
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/4.jpg saved to cache
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc5550>
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/7.jpg saved to cache
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009789110>
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/9.jpg saved to cache
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/5.jpg not downloaded yet
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911a810>
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/10.jpg saved to cache
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2b650>
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/8.jpg saved to cache
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/6.jpg not downloaded yet
2026-03-24 22:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28090>
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ex%252F6dbe315724df4a32aa73f098753f8213%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/3.jpg saved to cache
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f63b011-6860-565a-b21b-4983970a2e6c
2026-03-24 22:56:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f63b011-6860-565a-b21b-4983970a2e6c, skipping ID generation
2026-03-24 22:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f63b011-6860-565a-b21b-4983970a2e6c with scrape type 1
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f63b011-6860-565a-b21b-4983970a2e6c sending to next pipeline
2026-03-24 22:56:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8f63b011-6860-565a-b21b-4983970a2e6c, identifier: 1980482
2026-03-24 22:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/7.jpg not downloaded yet
2026-03-24 22:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8f63b011-6860-565a-b21b-4983970a2e6c with identifier: 1980482
2026-03-24 22:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8f63b011-6860-565a-b21b-4983970a2e6c with identifier: 1980482
2026-03-24 22:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8f63b011-6860-565a-b21b-4983970a2e6c with identifier: 1980482 to the API
2026-03-24 22:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8f63b011-6860-565a-b21b-4983970a2e6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 24335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f63b011-6860-565a-b21b-4983970a2e6c/8f63b011-6860-565a-b21b-4983970a2e6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ex/6dbe315724df4a32aa73f098753f8213/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.6 PHEV 180 S-S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 180 S-S AUTO ALLURE PACK',
 'vin': None,
 'year': 2024}
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980482%27 HTTP/1.1" 200 None
2026-03-24 22:56:02 [ayvens.be] INFO: Saving data for 1980482: {'created_time': 1774392962.192549, 'last_price_update_time': 1774392962.192559, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980482') HTTP/1.1" 204 0
2026-03-24 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/8.jpg not downloaded yet
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3150>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/7.jpg saved to cache
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc48d0>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/4.jpg saved to cache
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946fa50>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/5.jpg saved to cache
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4ed0>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/6.jpg saved to cache
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946f450>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/9.jpg saved to cache
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/9.jpg not downloaded yet
2026-03-24 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/10.jpg not downloaded yet
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8710>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/10.jpg saved to cache
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3bd0>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/8.jpg saved to cache
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ee5d0>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/3.jpg saved to cache
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:02 [ayvens.be] INFO: Found listing with ID: 1980485
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980485%27 HTTP/1.1" 200 None
2026-03-24 22:56:02 [ayvens.be] INFO: Scrape type for 1980485: 1
2026-03-24 22:56:02 [ayvens.be] INFO: Extracting data for car ID: 1980485
2026-03-24 22:56:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e69776c-945b-5aab-a92a-06594b48f9b9 with identifier: 1980485
2026-03-24 22:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e69776c-945b-5aab-a92a-06594b48f9b9 with scrape type 1
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/1.jpg not downloaded yet
2026-03-24 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083831d0>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F3eb0ff5faedd4d09ac0c1c0a3003130b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/2.jpg saved to cache
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4acde836-8759-5802-85f5-e7e4c5e1beca
2026-03-24 22:56:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4acde836-8759-5802-85f5-e7e4c5e1beca, skipping ID generation
2026-03-24 22:56:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acde836-8759-5802-85f5-e7e4c5e1beca with scrape type 1
2026-03-24 22:56:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4acde836-8759-5802-85f5-e7e4c5e1beca sending to next pipeline
2026-03-24 22:56:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4acde836-8759-5802-85f5-e7e4c5e1beca, identifier: 1980483
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838e310>
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/2.jpg saved to cache
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8d10>
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/1.jpg saved to cache
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c310>
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/3.jpg saved to cache
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/2.jpg not downloaded yet
2026-03-24 22:56:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4acde836-8759-5802-85f5-e7e4c5e1beca with identifier: 1980483
2026-03-24 22:56:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4acde836-8759-5802-85f5-e7e4c5e1beca with identifier: 1980483
2026-03-24 22:56:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4acde836-8759-5802-85f5-e7e4c5e1beca with identifier: 1980483 to the API
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4acde836-8759-5802-85f5-e7e4c5e1beca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 100298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acde836-8759-5802-85f5-e7e4c5e1beca/4acde836-8759-5802-85f5-e7e4c5e1beca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/3eb0ff5faedd4d09ac0c1c0a3003130b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980483%27 HTTP/1.1" 200 None
2026-03-24 22:56:03 [ayvens.be] INFO: Saving data for 1980483: {'created_time': 1774392963.678877, 'last_price_update_time': 1774392963.678888, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980483') HTTP/1.1" 204 0
2026-03-24 22:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/3.jpg not downloaded yet
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aa610>
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/6.jpg saved to cache
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009863610>
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/4.jpg saved to cache
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a36d0>
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/5.jpg saved to cache
2026-03-24 22:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/4.jpg not downloaded yet
2026-03-24 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00838d110>
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/7.jpg saved to cache
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/5.jpg not downloaded yet
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/6.jpg not downloaded yet
2026-03-24 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/7.jpg not downloaded yet
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978ae90>
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/8.jpg saved to cache
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493490>
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/9.jpg saved to cache
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/8.jpg not downloaded yet
2026-03-24 22:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/9.jpg not downloaded yet
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094426d0>
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fd66b6233921f47ecb04e4ffa55c88298%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/10.jpg saved to cache
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4663043-cff4-5c88-8a1a-8bd891f8805c
2026-03-24 22:56:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4663043-cff4-5c88-8a1a-8bd891f8805c, skipping ID generation
2026-03-24 22:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4663043-cff4-5c88-8a1a-8bd891f8805c with scrape type 1
2026-03-24 22:56:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4663043-cff4-5c88-8a1a-8bd891f8805c sending to next pipeline
2026-03-24 22:56:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f4663043-cff4-5c88-8a1a-8bd891f8805c, identifier: 1980484
2026-03-24 22:56:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f4663043-cff4-5c88-8a1a-8bd891f8805c with identifier: 1980484
2026-03-24 22:56:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f4663043-cff4-5c88-8a1a-8bd891f8805c with identifier: 1980484
2026-03-24 22:56:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f4663043-cff4-5c88-8a1a-8bd891f8805c with identifier: 1980484 to the API
2026-03-24 22:56:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f4663043-cff4-5c88-8a1a-8bd891f8805c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 179930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4663043-cff4-5c88-8a1a-8bd891f8805c/f4663043-cff4-5c88-8a1a-8bd891f8805c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/d66b6233921f47ecb04e4ffa55c88298/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 180 E-AUTO8 ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 180 E-AUTO8 ACTIVE PACK',
 'vin': None,
 'year': 2023}
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980484%27 HTTP/1.1" 200 None
2026-03-24 22:56:05 [ayvens.be] INFO: Saving data for 1980484: {'created_time': 1774392965.663869, 'last_price_update_time': 1774392965.66388, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980484') HTTP/1.1" 204 0
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/10.jpg not downloaded yet
2026-03-24 22:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce610>
2026-03-24 22:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/1.jpg saved to cache
2026-03-24 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b4c10>
2026-03-24 22:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/2.jpg saved to cache
2026-03-24 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:05 [ayvens.be] INFO: Found listing with ID: 1980486
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980486%27 HTTP/1.1" 200 None
2026-03-24 22:56:05 [ayvens.be] INFO: Scrape type for 1980486: 1
2026-03-24 22:56:05 [ayvens.be] INFO: Extracting data for car ID: 1980486
2026-03-24 22:56:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c52951fe-413c-577b-b815-1e7f4950c75e with identifier: 1980486
2026-03-24 22:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c52951fe-413c-577b-b815-1e7f4950c75e with scrape type 1
2026-03-24 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/1.jpg not downloaded yet
2026-03-24 22:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/2.jpg not downloaded yet
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/3.jpg not downloaded yet
2026-03-24 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/4.jpg not downloaded yet
2026-03-24 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/5.jpg not downloaded yet
2026-03-24 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/6.jpg not downloaded yet
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/7.jpg not downloaded yet
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/8.jpg not downloaded yet
2026-03-24 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/9.jpg not downloaded yet
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008326090>
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/4.jpg saved to cache
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/10.jpg not downloaded yet
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2dd0>
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/5.jpg saved to cache
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bd390>
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/3.jpg saved to cache
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:06 [ayvens.be] INFO: Found listing with ID: 1980487
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980487%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [ayvens.be] INFO: Scrape type for 1980487: 1
2026-03-24 22:56:06 [ayvens.be] INFO: Extracting data for car ID: 1980487
2026-03-24 22:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5 with identifier: 1980487
2026-03-24 22:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5 with scrape type 1
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/1.jpg not downloaded yet
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097638d0>
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/7.jpg saved to cache
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009120b50>
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/6.jpg saved to cache
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835a390>
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/8.jpg saved to cache
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835a6d0>
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/10.jpg saved to cache
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:06 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at -1 pages/min), scraped 474 items (at 32 items/min)
2026-03-24 22:56:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/2.jpg not downloaded yet
2026-03-24 22:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/3.jpg not downloaded yet
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a2d10>
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/1.jpg saved to cache
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/4.jpg not downloaded yet
2026-03-24 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/5.jpg not downloaded yet
2026-03-24 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/6.jpg not downloaded yet
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ca750>
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252Fc4d9f3b23c7c4fe3afbd2a6ac08110ff%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/9.jpg saved to cache
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e69776c-945b-5aab-a92a-06594b48f9b9
2026-03-24 22:56:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e69776c-945b-5aab-a92a-06594b48f9b9, skipping ID generation
2026-03-24 22:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e69776c-945b-5aab-a92a-06594b48f9b9 with scrape type 1
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e69776c-945b-5aab-a92a-06594b48f9b9 sending to next pipeline
2026-03-24 22:56:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7e69776c-945b-5aab-a92a-06594b48f9b9, identifier: 1980485
2026-03-24 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7e69776c-945b-5aab-a92a-06594b48f9b9 with identifier: 1980485
2026-03-24 22:56:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7e69776c-945b-5aab-a92a-06594b48f9b9 with identifier: 1980485
2026-03-24 22:56:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7e69776c-945b-5aab-a92a-06594b48f9b9 with identifier: 1980485 to the API
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7e69776c-945b-5aab-a92a-06594b48f9b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2020',
 'odometer': 150283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e69776c-945b-5aab-a92a-06594b48f9b9/7e69776c-945b-5aab-a92a-06594b48f9b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/c4d9f3b23c7c4fe3afbd2a6ac08110ff/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2020 1.5 BlueHDi GT Line',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi GT Line',
 'vin': None,
 'year': 2020}
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980485%27 HTTP/1.1" 200 None
2026-03-24 22:56:07 [ayvens.be] INFO: Saving data for 1980485: {'created_time': 1774392967.646231, 'last_price_update_time': 1774392967.64624, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980485') HTTP/1.1" 204 0
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/7.jpg not downloaded yet
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/8.jpg not downloaded yet
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2d50>
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/5.jpg saved to cache
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b6750>
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/4.jpg saved to cache
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091acd50>
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/7.jpg saved to cache
2026-03-24 22:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0290>
2026-03-24 22:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/3.jpg saved to cache
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00839bc10>
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/6.jpg saved to cache
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472510>
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/2.jpg saved to cache
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/9.jpg not downloaded yet
2026-03-24 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/10.jpg not downloaded yet
2026-03-24 22:56:08 [ayvens.be] INFO: Found listing with ID: 1980488
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980488%27 HTTP/1.1" 200 None
2026-03-24 22:56:08 [ayvens.be] INFO: Scrape type for 1980488: 1
2026-03-24 22:56:08 [ayvens.be] INFO: Extracting data for car ID: 1980488
2026-03-24 22:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a911f5b3-d68f-579e-87f8-576617b414c4 with identifier: 1980488
2026-03-24 22:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a911f5b3-d68f-579e-87f8-576617b414c4 with scrape type 1
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/1.jpg not downloaded yet
2026-03-24 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/2.jpg not downloaded yet
2026-03-24 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/3.jpg not downloaded yet
2026-03-24 22:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/4.jpg not downloaded yet
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009471d90>
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/8.jpg saved to cache
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/5.jpg not downloaded yet
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/6.jpg not downloaded yet
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110210>
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/9.jpg saved to cache
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091315d0>
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/1.jpg saved to cache
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008346690>
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/2.jpg saved to cache
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008344a10>
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F3c2bad23b77c4517876ec7ab8e5bd2ff%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/10.jpg saved to cache
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c52951fe-413c-577b-b815-1e7f4950c75e
2026-03-24 22:56:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c52951fe-413c-577b-b815-1e7f4950c75e, skipping ID generation
2026-03-24 22:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c52951fe-413c-577b-b815-1e7f4950c75e with scrape type 1
2026-03-24 22:56:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c52951fe-413c-577b-b815-1e7f4950c75e sending to next pipeline
2026-03-24 22:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c52951fe-413c-577b-b815-1e7f4950c75e, identifier: 1980486
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3a90>
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/3.jpg saved to cache
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bc310>
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/4.jpg saved to cache
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e410>
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/5.jpg saved to cache
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/7.jpg not downloaded yet
2026-03-24 22:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c52951fe-413c-577b-b815-1e7f4950c75e with identifier: 1980486
2026-03-24 22:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c52951fe-413c-577b-b815-1e7f4950c75e with identifier: 1980486
2026-03-24 22:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c52951fe-413c-577b-b815-1e7f4950c75e with identifier: 1980486 to the API
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c52951fe-413c-577b-b815-1e7f4950c75e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 113189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c52951fe-413c-577b-b815-1e7f4950c75e/c52951fe-413c-577b-b815-1e7f4950c75e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/3c2bad23b77c4517876ec7ab8e5bd2ff/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980486%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [ayvens.be] INFO: Saving data for 1980486: {'created_time': 1774392969.663317, 'last_price_update_time': 1774392969.663328, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980486') HTTP/1.1" 204 0
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/8.jpg not downloaded yet
2026-03-24 22:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/9.jpg not downloaded yet
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/10.jpg not downloaded yet
2026-03-24 22:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:09 [ayvens.be] INFO: Found listing with ID: 1980489
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980489%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [ayvens.be] INFO: Scrape type for 1980489: 1
2026-03-24 22:56:09 [ayvens.be] INFO: Extracting data for car ID: 1980489
2026-03-24 22:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with identifier: 1980489
2026-03-24 22:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with scrape type 1
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/1.jpg not downloaded yet
2026-03-24 22:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/2.jpg not downloaded yet
2026-03-24 22:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/3.jpg not downloaded yet
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091d7410>
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/8.jpg saved to cache
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/4.jpg not downloaded yet
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/5.jpg not downloaded yet
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/6.jpg not downloaded yet
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187e10>
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/9.jpg saved to cache
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938da10>
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/6.jpg saved to cache
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bf650>
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/2.jpg saved to cache
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009565390>
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/10.jpg saved to cache
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cee10>
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fcb34142c249b4ed9983e973e48f5aa8a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/7.jpg saved to cache
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5
2026-03-24 22:56:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5, skipping ID generation
2026-03-24 22:56:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5 with scrape type 1
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5 sending to next pipeline
2026-03-24 22:56:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5, identifier: 1980487
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed8850>
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/1.jpg saved to cache
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ab410>
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/5.jpg saved to cache
2026-03-24 22:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5 with identifier: 1980487
2026-03-24 22:56:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5 with identifier: 1980487
2026-03-24 22:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5 with identifier: 1980487 to the API
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': None,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 104335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5/c8aa9f15-9b6a-5876-ab26-1f1aaf0a0ea5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/cb34142c249b4ed9983e973e48f5aa8a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Utility FT Long DC SNOECKS 2.0L 120cv BVM6',
 'transmission': 'manual',
 'trim': 'Utility FT Long DC SNOECKS 2.0L 120cv BVM6',
 'vin': None,
 'year': 2020}
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980487%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [ayvens.be] INFO: Saving data for 1980487: {'created_time': 1774392971.040966, 'last_price_update_time': 1774392971.040978, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980487') HTTP/1.1" 204 0
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/7.jpg not downloaded yet
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/8.jpg not downloaded yet
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009707310>
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/4.jpg saved to cache
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/9.jpg not downloaded yet
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009177ad0>
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/3.jpg saved to cache
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009860c10>
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/7.jpg saved to cache
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/10.jpg not downloaded yet
2026-03-24 22:56:11 [ayvens.be] INFO: Found listing with ID: 1980490
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980490%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [ayvens.be] INFO: Scrape type for 1980490: 1
2026-03-24 22:56:11 [ayvens.be] INFO: Extracting data for car ID: 1980490
2026-03-24 22:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7696874-805f-5be8-b5ff-4078f283f07b with identifier: 1980490
2026-03-24 22:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7696874-805f-5be8-b5ff-4078f283f07b with scrape type 1
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/1.jpg not downloaded yet
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff017676d10>
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/6.jpg saved to cache
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959d5d0>
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/8.jpg saved to cache
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/2.jpg not downloaded yet
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/3.jpg not downloaded yet
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/4.jpg not downloaded yet
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/5.jpg not downloaded yet
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/6.jpg not downloaded yet
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/7.jpg not downloaded yet
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/8.jpg not downloaded yet
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009705090>
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/9.jpg saved to cache
2026-03-24 22:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083839d0>
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fbc60517b23fb4f62bd5eef66d76aaba1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/10.jpg saved to cache
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a911f5b3-d68f-579e-87f8-576617b414c4
2026-03-24 22:56:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a911f5b3-d68f-579e-87f8-576617b414c4, skipping ID generation
2026-03-24 22:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a911f5b3-d68f-579e-87f8-576617b414c4 with scrape type 1
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a911f5b3-d68f-579e-87f8-576617b414c4 sending to next pipeline
2026-03-24 22:56:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a911f5b3-d68f-579e-87f8-576617b414c4, identifier: 1980488
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/9.jpg not downloaded yet
2026-03-24 22:56:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a911f5b3-d68f-579e-87f8-576617b414c4 with identifier: 1980488
2026-03-24 22:56:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a911f5b3-d68f-579e-87f8-576617b414c4 with identifier: 1980488
2026-03-24 22:56:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a911f5b3-d68f-579e-87f8-576617b414c4 with identifier: 1980488 to the API
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a911f5b3-d68f-579e-87f8-576617b414c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON L-MWB DSL - 201',
 'odometer': 202154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a911f5b3-d68f-579e-87f8-576617b414c4/a911f5b3-d68f-579e-87f8-576617b414c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/bc60517b23fb4f62bd5eef66d76aaba1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seats_number': 6,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON L-MWB DSL - 201 2.0 BlueHDi L3 Long Utility '
          'S&S',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L3 Long Utility S&S',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980488%27 HTTP/1.1" 200 None
2026-03-24 22:56:12 [ayvens.be] INFO: Saving data for 1980488: {'created_time': 1774392972.456513, 'last_price_update_time': 1774392972.456523, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980488') HTTP/1.1" 204 0
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/10.jpg not downloaded yet
2026-03-24 22:56:12 [ayvens.be] INFO: Found listing with ID: 1980491
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980491%27 HTTP/1.1" 200 None
2026-03-24 22:56:12 [ayvens.be] INFO: Scrape type for 1980491: 1
2026-03-24 22:56:12 [ayvens.be] INFO: Extracting data for car ID: 1980491
2026-03-24 22:56:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cee14472-5229-5fa6-8340-3ab9f5e814c8 with identifier: 1980491
2026-03-24 22:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee14472-5229-5fa6-8340-3ab9f5e814c8 with scrape type 1
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/1.jpg not downloaded yet
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493810>
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/5.jpg saved to cache
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009464e90>
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/3.jpg saved to cache
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2a90>
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/4.jpg saved to cache
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095efa50>
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/6.jpg saved to cache
2026-03-24 22:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2010>
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/2.jpg saved to cache
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2a450>
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/1.jpg saved to cache
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/2.jpg not downloaded yet
2026-03-24 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/3.jpg not downloaded yet
2026-03-24 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/4.jpg not downloaded yet
2026-03-24 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/5.jpg not downloaded yet
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/6.jpg not downloaded yet
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/7.jpg not downloaded yet
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008312f90>
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/9.jpg saved to cache
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/8.jpg not downloaded yet
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/9.jpg not downloaded yet
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/10.jpg not downloaded yet
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9c10>
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/10.jpg saved to cache
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098de990>
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/1.jpg saved to cache
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610f90>
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/3.jpg saved to cache
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098df910>
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/7.jpg saved to cache
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098dcd90>
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/4.jpg saved to cache
2026-03-24 22:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347250>
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2df%252F1a43fa5bf5e24303b485acc30d7a61ae%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/8.jpg saved to cache
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9
2026-03-24 22:56:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9, skipping ID generation
2026-03-24 22:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with scrape type 1
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 sending to next pipeline
2026-03-24 22:56:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9, identifier: 1980489
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094664d0>
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/2.jpg saved to cache
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with identifier: 1980489
2026-03-24 22:56:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with identifier: 1980489
2026-03-24 22:56:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a86a63cd-4b75-5d5a-88ab-2edf899ef6f9 with identifier: 1980489 to the API
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a86a63cd-4b75-5d5a-88ab-2edf899ef6f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'EV6',
 'odometer': 76315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a86a63cd-4b75-5d5a-88ab-2edf899ef6f9/a86a63cd-4b75-5d5a-88ab-2edf899ef6f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2df/1a43fa5bf5e24303b485acc30d7a61ae/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA EV6 BEV 77KWH EARTH AUTO RWD',
 'transmission': 'automatic',
 'trim': 'BEV 77KWH EARTH AUTO RWD',
 'vin': None,
 'year': 2023}
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980489%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [ayvens.be] INFO: Saving data for 1980489: {'created_time': 1774392974.616639, 'last_price_update_time': 1774392974.616649, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980489') HTTP/1.1" 204 0
2026-03-24 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:14 [ayvens.be] INFO: Found listing with ID: 1980492
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980492%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [ayvens.be] INFO: Scrape type for 1980492: 1
2026-03-24 22:56:14 [ayvens.be] INFO: Extracting data for car ID: 1980492
2026-03-24 22:56:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59babc83-9f5d-5966-a8f2-c216e9b40143 with identifier: 1980492
2026-03-24 22:56:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59babc83-9f5d-5966-a8f2-c216e9b40143 with scrape type 1
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/1.jpg not downloaded yet
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/2.jpg not downloaded yet
2026-03-24 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/3.jpg not downloaded yet
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/4.jpg not downloaded yet
2026-03-24 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/5.jpg not downloaded yet
2026-03-24 22:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/6.jpg not downloaded yet
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008398fd0>
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/9.jpg saved to cache
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/7.jpg not downloaded yet
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/8.jpg not downloaded yet
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/9.jpg not downloaded yet
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f5a90>
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/8.jpg saved to cache
2026-03-24 22:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed0850>
2026-03-24 22:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/10.jpg saved to cache
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009011110>
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/7.jpg saved to cache
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959f350>
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/6.jpg saved to cache
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613110>
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F1fd7fd4ed4274c3ca85cb64d793f557d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/5.jpg saved to cache
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7696874-805f-5be8-b5ff-4078f283f07b
2026-03-24 22:56:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7696874-805f-5be8-b5ff-4078f283f07b, skipping ID generation
2026-03-24 22:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7696874-805f-5be8-b5ff-4078f283f07b with scrape type 1
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7696874-805f-5be8-b5ff-4078f283f07b sending to next pipeline
2026-03-24 22:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7696874-805f-5be8-b5ff-4078f283f07b, identifier: 1980490
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0b10>
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/2.jpg saved to cache
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed2d90>
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/1.jpg saved to cache
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7696874-805f-5be8-b5ff-4078f283f07b with identifier: 1980490
2026-03-24 22:56:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7696874-805f-5be8-b5ff-4078f283f07b with identifier: 1980490
2026-03-24 22:56:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7696874-805f-5be8-b5ff-4078f283f07b with identifier: 1980490 to the API
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'e7696874-805f-5be8-b5ff-4078f283f07b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 119616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7696874-805f-5be8-b5ff-4078f283f07b/e7696874-805f-5be8-b5ff-4078f283f07b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/1fd7fd4ed4274c3ca85cb64d793f557d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980490%27 HTTP/1.1" 200 None
2026-03-24 22:56:15 [ayvens.be] INFO: Saving data for 1980490: {'created_time': 1774392975.893664, 'last_price_update_time': 1774392975.893673, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980490') HTTP/1.1" 204 0
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/10.jpg not downloaded yet
2026-03-24 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:15 [ayvens.be] INFO: Found listing with ID: 1980493
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980493%27 HTTP/1.1" 200 None
2026-03-24 22:56:15 [ayvens.be] INFO: Scrape type for 1980493: 1
2026-03-24 22:56:15 [ayvens.be] INFO: Extracting data for car ID: 1980493
2026-03-24 22:56:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3139f78f-a223-5550-b66f-04b1d343b807 with identifier: 1980493
2026-03-24 22:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3139f78f-a223-5550-b66f-04b1d343b807 with scrape type 1
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/1.jpg not downloaded yet
2026-03-24 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/2.jpg not downloaded yet
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/3.jpg not downloaded yet
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/4.jpg not downloaded yet
2026-03-24 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/5.jpg not downloaded yet
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008311fd0>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/6.jpg saved to cache
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083268d0>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/3.jpg saved to cache
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/6.jpg not downloaded yet
2026-03-24 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097047d0>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/7.jpg saved to cache
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/7.jpg not downloaded yet
2026-03-24 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/8.jpg not downloaded yet
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009707850>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/8.jpg saved to cache
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310a50>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/5.jpg saved to cache
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945de90>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/1.jpg saved to cache
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083369d0>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/9.jpg saved to cache
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962ef50>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/4.jpg saved to cache
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/9.jpg not downloaded yet
2026-03-24 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/10.jpg not downloaded yet
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8c90>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/2.jpg saved to cache
2026-03-24 22:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009113510>
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F31e4ca31acbd4a4dab0940be8e793709%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/10.jpg saved to cache
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cee14472-5229-5fa6-8340-3ab9f5e814c8
2026-03-24 22:56:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cee14472-5229-5fa6-8340-3ab9f5e814c8, skipping ID generation
2026-03-24 22:56:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee14472-5229-5fa6-8340-3ab9f5e814c8 with scrape type 1
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cee14472-5229-5fa6-8340-3ab9f5e814c8 sending to next pipeline
2026-03-24 22:56:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cee14472-5229-5fa6-8340-3ab9f5e814c8, identifier: 1980491
2026-03-24 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:17 [ayvens.be] INFO: Found listing with ID: 1980494
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980494%27 HTTP/1.1" 200 None
2026-03-24 22:56:17 [ayvens.be] INFO: Scrape type for 1980494: 1
2026-03-24 22:56:17 [ayvens.be] INFO: Extracting data for car ID: 1980494
2026-03-24 22:56:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1980494
2026-03-24 22:56:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f987ca01-5c91-5382-9e54-a5af158d6ca0 with scrape type 1
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/1.jpg not downloaded yet
2026-03-24 22:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cee14472-5229-5fa6-8340-3ab9f5e814c8 with identifier: 1980491
2026-03-24 22:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cee14472-5229-5fa6-8340-3ab9f5e814c8 with identifier: 1980491
2026-03-24 22:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cee14472-5229-5fa6-8340-3ab9f5e814c8 with identifier: 1980491 to the API
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cee14472-5229-5fa6-8340-3ab9f5e814c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 150966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cee14472-5229-5fa6-8340-3ab9f5e814c8/cee14472-5229-5fa6-8340-3ab9f5e814c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/31e4ca31acbd4a4dab0940be8e793709/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980491%27 HTTP/1.1" 200 None
2026-03-24 22:56:17 [ayvens.be] INFO: Saving data for 1980491: {'created_time': 1774392977.51607, 'last_price_update_time': 1774392977.51608, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980491') HTTP/1.1" 204 0
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/2.jpg not downloaded yet
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/3.jpg not downloaded yet
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c0710>
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/3.jpg saved to cache
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945e310>
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/7.jpg saved to cache
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963bbd0>
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/5.jpg saved to cache
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009706150>
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/6.jpg saved to cache
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336710>
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/4.jpg saved to cache
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/4.jpg not downloaded yet
2026-03-24 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/5.jpg not downloaded yet
2026-03-24 22:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/6.jpg not downloaded yet
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/7.jpg not downloaded yet
2026-03-24 22:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/8.jpg not downloaded yet
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/9.jpg not downloaded yet
2026-03-24 22:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/10.jpg not downloaded yet
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967e2d0>
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/10.jpg saved to cache
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b5810>
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/8.jpg saved to cache
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:18 [ayvens.be] INFO: Found listing with ID: 1980495
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980495%27 HTTP/1.1" 200 None
2026-03-24 22:56:18 [ayvens.be] INFO: Scrape type for 1980495: 1
2026-03-24 22:56:18 [ayvens.be] INFO: Extracting data for car ID: 1980495
2026-03-24 22:56:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b with identifier: 1980495
2026-03-24 22:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b with scrape type 1
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/1.jpg not downloaded yet
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/2.jpg not downloaded yet
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008311010>
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252F4d4d23bd78554aa98410a4e83adfe7ac%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/9.jpg saved to cache
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59babc83-9f5d-5966-a8f2-c216e9b40143
2026-03-24 22:56:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59babc83-9f5d-5966-a8f2-c216e9b40143, skipping ID generation
2026-03-24 22:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59babc83-9f5d-5966-a8f2-c216e9b40143 with scrape type 1
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59babc83-9f5d-5966-a8f2-c216e9b40143 sending to next pipeline
2026-03-24 22:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59babc83-9f5d-5966-a8f2-c216e9b40143, identifier: 1980492
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009703f10>
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/1.jpg saved to cache
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008325850>
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/2.jpg saved to cache
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed06d0>
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/3.jpg saved to cache
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e8d0>
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/6.jpg saved to cache
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643d10>
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/5.jpg saved to cache
2026-03-24 22:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59babc83-9f5d-5966-a8f2-c216e9b40143 with identifier: 1980492
2026-03-24 22:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59babc83-9f5d-5966-a8f2-c216e9b40143 with identifier: 1980492
2026-03-24 22:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59babc83-9f5d-5966-a8f2-c216e9b40143 with identifier: 1980492 to the API
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '59babc83-9f5d-5966-a8f2-c216e9b40143',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU LWB DSL -',
 'odometer': 222842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59babc83-9f5d-5966-a8f2-c216e9b40143/59babc83-9f5d-5966-a8f2-c216e9b40143_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/4d4d23bd78554aa98410a4e83adfe7ac/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU LWB DSL - 2.0 TDi SCR BMT STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR BMT STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980492%27 HTTP/1.1" 200 None
2026-03-24 22:56:19 [ayvens.be] INFO: Saving data for 1980492: {'created_time': 1774392979.228343, 'last_price_update_time': 1774392979.228354, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980492') HTTP/1.1" 204 0
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/3.jpg not downloaded yet
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/4.jpg not downloaded yet
2026-03-24 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/5.jpg not downloaded yet
2026-03-24 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/6.jpg not downloaded yet
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/7.jpg not downloaded yet
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/8.jpg not downloaded yet
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/9.jpg not downloaded yet
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/10.jpg not downloaded yet
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334c50>
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/1.jpg saved to cache
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009792190>
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/3.jpg saved to cache
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098be110>
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/8.jpg saved to cache
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098befd0>
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/2.jpg saved to cache
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009395f90>
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/9.jpg saved to cache
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009010450>
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/10.jpg saved to cache
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098bc0d0>
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/4.jpg saved to cache
2026-03-24 22:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfc4d0>
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252Fbf329c7af45e4c9983d698437fdc4cf8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/7.jpg saved to cache
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3139f78f-a223-5550-b66f-04b1d343b807
2026-03-24 22:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3139f78f-a223-5550-b66f-04b1d343b807, skipping ID generation
2026-03-24 22:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3139f78f-a223-5550-b66f-04b1d343b807 with scrape type 1
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3139f78f-a223-5550-b66f-04b1d343b807 sending to next pipeline
2026-03-24 22:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3139f78f-a223-5550-b66f-04b1d343b807, identifier: 1980493
2026-03-24 22:56:20 [ayvens.be] INFO: Found listing with ID: 1980496
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980496%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [ayvens.be] INFO: Scrape type for 1980496: 1
2026-03-24 22:56:20 [ayvens.be] INFO: Extracting data for car ID: 1980496
2026-03-24 22:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a145d80c-639b-5a54-a86b-12b6eadb835d with identifier: 1980496
2026-03-24 22:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a145d80c-639b-5a54-a86b-12b6eadb835d with scrape type 1
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/1.jpg not downloaded yet
2026-03-24 22:56:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3139f78f-a223-5550-b66f-04b1d343b807 with identifier: 1980493
2026-03-24 22:56:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3139f78f-a223-5550-b66f-04b1d343b807 with identifier: 1980493
2026-03-24 22:56:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3139f78f-a223-5550-b66f-04b1d343b807 with identifier: 1980493 to the API
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '3139f78f-a223-5550-b66f-04b1d343b807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 57863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613870,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3139f78f-a223-5550-b66f-04b1d343b807/3139f78f-a223-5550-b66f-04b1d343b807_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/bf329c7af45e4c9983d698437fdc4cf8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 520D 120KW TOURING AUTO',
 'transmission': 'automatic',
 'trim': '2.0 520D 120KW TOURING AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980493%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [ayvens.be] INFO: Saving data for 1980493: {'created_time': 1774392980.546411, 'last_price_update_time': 1774392980.546421, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980493') HTTP/1.1" 204 0
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/2.jpg not downloaded yet
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/3.jpg not downloaded yet
2026-03-24 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/4.jpg not downloaded yet
2026-03-24 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/5.jpg not downloaded yet
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/6.jpg not downloaded yet
2026-03-24 22:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/7.jpg not downloaded yet
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/8.jpg not downloaded yet
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/9.jpg not downloaded yet
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097596d0>
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/4.jpg saved to cache
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/10.jpg not downloaded yet
2026-03-24 22:56:20 [ayvens.be] INFO: Found listing with ID: 1980497
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980497%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [ayvens.be] INFO: Scrape type for 1980497: 1
2026-03-24 22:56:20 [ayvens.be] INFO: Extracting data for car ID: 1980497
2026-03-24 22:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498381f1-5478-5351-a31b-5a9e1b531449 with identifier: 1980497
2026-03-24 22:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498381f1-5478-5351-a31b-5a9e1b531449 with scrape type 1
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/1.jpg not downloaded yet
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912b5d0>
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/10.jpg saved to cache
2026-03-24 22:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f7390>
2026-03-24 22:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/1.jpg saved to cache
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc6750>
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/6.jpg saved to cache
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cd8610>
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/7.jpg saved to cache
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d9410>
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/5.jpg saved to cache
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372fd0>
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/9.jpg saved to cache
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4f90>
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8cab5d8f11534c709a19cfca170ac403%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/8.jpg saved to cache
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-03-24 22:56:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f987ca01-5c91-5382-9e54-a5af158d6ca0, skipping ID generation
2026-03-24 22:56:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f987ca01-5c91-5382-9e54-a5af158d6ca0 with scrape type 1
2026-03-24 22:56:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f987ca01-5c91-5382-9e54-a5af158d6ca0 sending to next pipeline
2026-03-24 22:56:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f987ca01-5c91-5382-9e54-a5af158d6ca0, identifier: 1980494
2026-03-24 22:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1980494
2026-03-24 22:56:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1980494
2026-03-24 22:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1980494 to the API
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'lpg',
 'id': 'f987ca01-5c91-5382-9e54-a5af158d6ca0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 118163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8cab5d8f11534c709a19cfca170ac403/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 40 G-TRON S TRONIC ADVANCED BUS. ED. CNG',
 'transmission': 'automatic',
 'trim': '2.0 40 G-TRON S TRONIC ADVANCED BUS. ED. CNG',
 'vin': None,
 'year': 2020}
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980494%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [ayvens.be] INFO: Saving data for 1980494: {'created_time': 1774392982.10272, 'last_price_update_time': 1774392982.10273, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980494') HTTP/1.1" 204 0
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/2.jpg not downloaded yet
2026-03-24 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/3.jpg not downloaded yet
2026-03-24 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/4.jpg not downloaded yet
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/5.jpg not downloaded yet
2026-03-24 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/6.jpg not downloaded yet
2026-03-24 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/7.jpg not downloaded yet
2026-03-24 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/8.jpg not downloaded yet
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/9.jpg not downloaded yet
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3dd0>
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/3.jpg saved to cache
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/10.jpg not downloaded yet
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bbe90>
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/4.jpg saved to cache
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009773690>
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/1.jpg saved to cache
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94b10>
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/2.jpg saved to cache
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:22 [ayvens.be] INFO: Found listing with ID: 1980498
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980498%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [ayvens.be] INFO: Scrape type for 1980498: 1
2026-03-24 22:56:22 [ayvens.be] INFO: Extracting data for car ID: 1980498
2026-03-24 22:56:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a6501d-97ae-5b09-a2ce-ace7338f8598 with identifier: 1980498
2026-03-24 22:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a6501d-97ae-5b09-a2ce-ace7338f8598 with scrape type 1
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/1.jpg not downloaded yet
2026-03-24 22:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/2.jpg not downloaded yet
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3a10>
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/8.jpg saved to cache
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009133fd0>
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/9.jpg saved to cache
2026-03-24 22:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c3950>
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/7.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cff810>
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/10.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/3.jpg not downloaded yet
2026-03-24 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/4.jpg not downloaded yet
2026-03-24 22:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a9c50>
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/9.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/5.jpg not downloaded yet
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/6.jpg not downloaded yet
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/7.jpg not downloaded yet
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009396890>
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/4.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641550>
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/2.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28510>
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/3.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009640510>
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/10.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8410>
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/5.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959c250>
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/5.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeaf5d0>
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F27c922dc8f5c478aa53781b2db6d6cb9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/6.jpg saved to cache
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b
2026-03-24 22:56:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b, skipping ID generation
2026-03-24 22:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b with scrape type 1
2026-03-24 22:56:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b sending to next pipeline
2026-03-24 22:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b, identifier: 1980495
2026-03-24 22:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b with identifier: 1980495
2026-03-24 22:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b with identifier: 1980495
2026-03-24 22:56:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5ad60ee3-32e3-5426-b143-5fdbdbd3e84b with identifier: 1980495 to the API
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ad60ee3-32e3-5426-b143-5fdbdbd3e84b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER 335 FOURGON MWB HR DSL -',
 'odometer': 73582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad60ee3-32e3-5426-b143-5fdbdbd3e84b/5ad60ee3-32e3-5426-b143-5fdbdbd3e84b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/27c922dc8f5c478aa53781b2db6d6cb9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 335 FOURGON MWB HR DSL - 2.2 BlueHDi L2H2 Premium S&S',
 'transmission': 'manual',
 'trim': '2.2 BlueHDi L2H2 Premium S&S',
 'vin': None,
 'year': 2019}
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980495%27 HTTP/1.1" 200 None
2026-03-24 22:56:24 [ayvens.be] INFO: Saving data for 1980495: {'created_time': 1774392984.524006, 'last_price_update_time': 1774392984.524017, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980495') HTTP/1.1" 204 0
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/8.jpg not downloaded yet
2026-03-24 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/9.jpg not downloaded yet
2026-03-24 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/10.jpg not downloaded yet
2026-03-24 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:24 [ayvens.be] INFO: Found listing with ID: 1980499
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980499%27 HTTP/1.1" 200 None
2026-03-24 22:56:24 [ayvens.be] INFO: Scrape type for 1980499: 1
2026-03-24 22:56:24 [ayvens.be] INFO: Extracting data for car ID: 1980499
2026-03-24 22:56:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38ee1521-30fc-5153-b980-e6c443fba2e2 with identifier: 1980499
2026-03-24 22:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ee1521-30fc-5153-b980-e6c443fba2e2 with scrape type 1
2026-03-24 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/1.jpg not downloaded yet
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/2.jpg not downloaded yet
2026-03-24 22:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeafd10>
2026-03-24 22:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/2.jpg saved to cache
2026-03-24 22:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009458a50>
2026-03-24 22:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/5.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914cd50>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/1.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd490>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/9.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/3.jpg not downloaded yet
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492b90>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/3.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008381250>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/8.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c3e50>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/10.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/4.jpg not downloaded yet
2026-03-24 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/5.jpg not downloaded yet
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2050>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/4.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/6.jpg not downloaded yet
2026-03-24 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/7.jpg not downloaded yet
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309950>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/2.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096382d0>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/1.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8a90>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/6.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009443250>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/8.jpg saved to cache
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/8.jpg not downloaded yet
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/9.jpg not downloaded yet
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/10.jpg not downloaded yet
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8cd0>
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fa4b69c76ae054489b793ebdbf4dc7478%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/7.jpg saved to cache
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 498381f1-5478-5351-a31b-5a9e1b531449
2026-03-24 22:56:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 498381f1-5478-5351-a31b-5a9e1b531449, skipping ID generation
2026-03-24 22:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498381f1-5478-5351-a31b-5a9e1b531449 with scrape type 1
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 498381f1-5478-5351-a31b-5a9e1b531449 sending to next pipeline
2026-03-24 22:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 498381f1-5478-5351-a31b-5a9e1b531449, identifier: 1980497
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009471090>
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/3.jpg saved to cache
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175950>
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/7.jpg saved to cache
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 498381f1-5478-5351-a31b-5a9e1b531449 with identifier: 1980497
2026-03-24 22:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 498381f1-5478-5351-a31b-5a9e1b531449 with identifier: 1980497
2026-03-24 22:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 498381f1-5478-5351-a31b-5a9e1b531449 with identifier: 1980497 to the API
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '498381f1-5478-5351-a31b-5a9e1b531449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 99655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498381f1-5478-5351-a31b-5a9e1b531449/498381f1-5478-5351-a31b-5a9e1b531449_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/a4b69c76ae054489b793ebdbf4dc7478/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 S LINE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 S LINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980497%27 HTTP/1.1" 200 None
2026-03-24 22:56:26 [ayvens.be] INFO: Saving data for 1980497: {'created_time': 1774392986.764166, 'last_price_update_time': 1774392986.764178, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980497') HTTP/1.1" 204 0
2026-03-24 22:56:26 [ayvens.be] INFO: Found listing with ID: 1980500
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980500%27 HTTP/1.1" 200 None
2026-03-24 22:56:26 [ayvens.be] INFO: Scrape type for 1980500: 1
2026-03-24 22:56:26 [ayvens.be] INFO: Extracting data for car ID: 1980500
2026-03-24 22:56:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eff94e67-cb37-5cf5-899d-228774d52497 with identifier: 1980500
2026-03-24 22:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eff94e67-cb37-5cf5-899d-228774d52497 with scrape type 1
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/1.jpg not downloaded yet
2026-03-24 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/2.jpg not downloaded yet
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008383b90>
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eg%252F67491566667748bc931cbbbea139ec96%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/6.jpg saved to cache
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a145d80c-639b-5a54-a86b-12b6eadb835d
2026-03-24 22:56:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a145d80c-639b-5a54-a86b-12b6eadb835d, skipping ID generation
2026-03-24 22:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a145d80c-639b-5a54-a86b-12b6eadb835d with scrape type 1
2026-03-24 22:56:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a145d80c-639b-5a54-a86b-12b6eadb835d sending to next pipeline
2026-03-24 22:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a145d80c-639b-5a54-a86b-12b6eadb835d, identifier: 1980496
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009176790>
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/9.jpg saved to cache
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a91d0>
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/8.jpg saved to cache
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008327a10>
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/6.jpg saved to cache
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/3.jpg not downloaded yet
2026-03-24 22:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a145d80c-639b-5a54-a86b-12b6eadb835d with identifier: 1980496
2026-03-24 22:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a145d80c-639b-5a54-a86b-12b6eadb835d with identifier: 1980496
2026-03-24 22:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a145d80c-639b-5a54-a86b-12b6eadb835d with identifier: 1980496 to the API
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a145d80c-639b-5a54-a86b-12b6eadb835d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C3 AIRCROSS',
 'odometer': 44479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a145d80c-639b-5a54-a86b-12b6eadb835d/a145d80c-639b-5a54-a86b-12b6eadb835d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eg/67491566667748bc931cbbbea139ec96/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C3 AIRCROSS 1.2 PURETECH 110 S&S BVM FEEL',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 110 S&S BVM FEEL',
 'vin': None,
 'year': 2023}
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980496%27 HTTP/1.1" 200 None
2026-03-24 22:56:27 [ayvens.be] INFO: Saving data for 1980496: {'created_time': 1774392987.623911, 'last_price_update_time': 1774392987.623922, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980496') HTTP/1.1" 204 0
2026-03-24 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/4.jpg not downloaded yet
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098dd650>
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/7.jpg saved to cache
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d8250>
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/5.jpg saved to cache
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/5.jpg not downloaded yet
2026-03-24 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/6.jpg not downloaded yet
2026-03-24 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7bd0>
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/2.jpg saved to cache
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/7.jpg not downloaded yet
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/8.jpg not downloaded yet
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/9.jpg not downloaded yet
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830ab10>
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/4.jpg saved to cache
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830a950>
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F47f86006e6dd4ea091ea859cf1330f72%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/10.jpg saved to cache
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9a6501d-97ae-5b09-a2ce-ace7338f8598
2026-03-24 22:56:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9a6501d-97ae-5b09-a2ce-ace7338f8598, skipping ID generation
2026-03-24 22:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a6501d-97ae-5b09-a2ce-ace7338f8598 with scrape type 1
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9a6501d-97ae-5b09-a2ce-ace7338f8598 sending to next pipeline
2026-03-24 22:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a9a6501d-97ae-5b09-a2ce-ace7338f8598, identifier: 1980498
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096154d0>
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/6.jpg saved to cache
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492b90>
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/4.jpg saved to cache
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610810>
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/5.jpg saved to cache
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3f10>
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/1.jpg saved to cache
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009628810>
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/3.jpg saved to cache
2026-03-24 22:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a9a6501d-97ae-5b09-a2ce-ace7338f8598 with identifier: 1980498
2026-03-24 22:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a9a6501d-97ae-5b09-a2ce-ace7338f8598 with identifier: 1980498
2026-03-24 22:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a9a6501d-97ae-5b09-a2ce-ace7338f8598 with identifier: 1980498 to the API
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a9a6501d-97ae-5b09-a2ce-ace7338f8598',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 110560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a6501d-97ae-5b09-a2ce-ace7338f8598/a9a6501d-97ae-5b09-a2ce-ace7338f8598_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/47f86006e6dd4ea091ea859cf1330f72/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH PERFORMANCE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH PERFORMANCE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980498%27 HTTP/1.1" 200 None
2026-03-24 22:56:29 [ayvens.be] INFO: Saving data for 1980498: {'created_time': 1774392989.091688, 'last_price_update_time': 1774392989.091698, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980498') HTTP/1.1" 204 0
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/10.jpg not downloaded yet
2026-03-24 22:56:29 [ayvens.be] INFO: Found listing with ID: 1980501
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980501%27 HTTP/1.1" 200 None
2026-03-24 22:56:29 [ayvens.be] INFO: Scrape type for 1980501: 1
2026-03-24 22:56:29 [ayvens.be] INFO: Extracting data for car ID: 1980501
2026-03-24 22:56:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c15c3042-dda2-5b63-a4f3-55042919f60f with identifier: 1980501
2026-03-24 22:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15c3042-dda2-5b63-a4f3-55042919f60f with scrape type 1
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/1.jpg not downloaded yet
2026-03-24 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009628990>
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/10.jpg saved to cache
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/2.jpg not downloaded yet
2026-03-24 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/3.jpg not downloaded yet
2026-03-24 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/4.jpg not downloaded yet
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1190>
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/1.jpg saved to cache
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/5.jpg not downloaded yet
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/6.jpg not downloaded yet
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018890>
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/9.jpg saved to cache
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c350>
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/7.jpg saved to cache
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836ae50>
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fca649ef60fbb4ed691f1f90f9dd36e9a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/8.jpg saved to cache
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38ee1521-30fc-5153-b980-e6c443fba2e2
2026-03-24 22:56:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38ee1521-30fc-5153-b980-e6c443fba2e2, skipping ID generation
2026-03-24 22:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ee1521-30fc-5153-b980-e6c443fba2e2 with scrape type 1
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38ee1521-30fc-5153-b980-e6c443fba2e2 sending to next pipeline
2026-03-24 22:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 38ee1521-30fc-5153-b980-e6c443fba2e2, identifier: 1980499
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096652d0>
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/3.jpg saved to cache
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e410>
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/2.jpg saved to cache
2026-03-24 22:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144f10>
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/5.jpg saved to cache
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/7.jpg not downloaded yet
2026-03-24 22:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 38ee1521-30fc-5153-b980-e6c443fba2e2 with identifier: 1980499
2026-03-24 22:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 38ee1521-30fc-5153-b980-e6c443fba2e2 with identifier: 1980499
2026-03-24 22:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 38ee1521-30fc-5153-b980-e6c443fba2e2 with identifier: 1980499 to the API
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '38ee1521-30fc-5153-b980-e6c443fba2e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID4',
 'odometer': 66959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ee1521-30fc-5153-b980-e6c443fba2e2/38ee1521-30fc-5153-b980-e6c443fba2e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ca649ef60fbb4ed691f1f90f9dd36e9a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID4 BEV 82KWH PRO FAMILY',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH PRO FAMILY',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980499%27 HTTP/1.1" 200 None
2026-03-24 22:56:30 [ayvens.be] INFO: Saving data for 1980499: {'created_time': 1774392990.377698, 'last_price_update_time': 1774392990.377708, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980499') HTTP/1.1" 204 0
2026-03-24 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/8.jpg not downloaded yet
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/9.jpg not downloaded yet
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bfca890>
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/4.jpg saved to cache
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/10.jpg not downloaded yet
2026-03-24 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:30 [ayvens.be] INFO: Found listing with ID: 1980502
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980502%27 HTTP/1.1" 200 None
2026-03-24 22:56:30 [ayvens.be] INFO: Scrape type for 1980502: 1
2026-03-24 22:56:30 [ayvens.be] INFO: Extracting data for car ID: 1980502
2026-03-24 22:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a98301-746b-5629-a92d-24d79beff483 with identifier: 1980502
2026-03-24 22:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a98301-746b-5629-a92d-24d79beff483 with scrape type 1
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/1.jpg not downloaded yet
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfd3d0>
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/6.jpg saved to cache
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/2.jpg not downloaded yet
2026-03-24 22:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/3.jpg not downloaded yet
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02390>
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/10.jpg saved to cache
2026-03-24 22:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009707590>
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/8.jpg saved to cache
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fbed0>
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/7.jpg saved to cache
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309710>
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F3810800a29454cb6854e7b3697befbea%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/9.jpg saved to cache
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eff94e67-cb37-5cf5-899d-228774d52497
2026-03-24 22:56:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eff94e67-cb37-5cf5-899d-228774d52497, skipping ID generation
2026-03-24 22:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eff94e67-cb37-5cf5-899d-228774d52497 with scrape type 1
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eff94e67-cb37-5cf5-899d-228774d52497 sending to next pipeline
2026-03-24 22:56:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eff94e67-cb37-5cf5-899d-228774d52497, identifier: 1980500
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c3a10>
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/1.jpg saved to cache
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442390>
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/2.jpg saved to cache
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830b850>
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/3.jpg saved to cache
2026-03-24 22:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eff94e67-cb37-5cf5-899d-228774d52497 with identifier: 1980500
2026-03-24 22:56:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eff94e67-cb37-5cf5-899d-228774d52497 with identifier: 1980500
2026-03-24 22:56:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eff94e67-cb37-5cf5-899d-228774d52497 with identifier: 1980500 to the API
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eff94e67-cb37-5cf5-899d-228774d52497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 71331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff94e67-cb37-5cf5-899d-228774d52497/eff94e67-cb37-5cf5-899d-228774d52497_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/3810800a29454cb6854e7b3697befbea/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 2.0 A 180 D BUSINESS SOLUTION '
          'ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 A 180 D BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980500%27 HTTP/1.1" 200 None
2026-03-24 22:56:31 [ayvens.be] INFO: Saving data for 1980500: {'created_time': 1774392991.993095, 'last_price_update_time': 1774392991.993104, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980500') HTTP/1.1" 204 0
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/4.jpg not downloaded yet
2026-03-24 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008371b50>
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/4.jpg saved to cache
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/5.jpg not downloaded yet
2026-03-24 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/6.jpg not downloaded yet
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/7.jpg not downloaded yet
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009142350>
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/9.jpg saved to cache
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d8650>
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/5.jpg saved to cache
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/8.jpg not downloaded yet
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/9.jpg not downloaded yet
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009443cd0>
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/6.jpg saved to cache
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a12d0>
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/7.jpg saved to cache
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938fe50>
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/8.jpg saved to cache
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1590>
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fed45b5d9890c467b97e35f754a79f944%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/10.jpg saved to cache
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c15c3042-dda2-5b63-a4f3-55042919f60f
2026-03-24 22:56:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c15c3042-dda2-5b63-a4f3-55042919f60f, skipping ID generation
2026-03-24 22:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15c3042-dda2-5b63-a4f3-55042919f60f with scrape type 1
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c15c3042-dda2-5b63-a4f3-55042919f60f sending to next pipeline
2026-03-24 22:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c15c3042-dda2-5b63-a4f3-55042919f60f, identifier: 1980501
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091772d0>
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/1.jpg saved to cache
2026-03-24 22:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c15c3042-dda2-5b63-a4f3-55042919f60f with identifier: 1980501
2026-03-24 22:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c15c3042-dda2-5b63-a4f3-55042919f60f with identifier: 1980501
2026-03-24 22:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c15c3042-dda2-5b63-a4f3-55042919f60f with identifier: 1980501 to the API
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c15c3042-dda2-5b63-a4f3-55042919f60f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 107933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c15c3042-dda2-5b63-a4f3-55042919f60f/c15c3042-dda2-5b63-a4f3-55042919f60f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/ed45b5d9890c467b97e35f754a79f944/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980501%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [ayvens.be] INFO: Saving data for 1980501: {'created_time': 1774392993.10319, 'last_price_update_time': 1774392993.1032, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980501') HTTP/1.1" 204 0
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/10.jpg not downloaded yet
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009718590>
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/2.jpg saved to cache
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:33 [ayvens.be] INFO: Found listing with ID: 1980503
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980503%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [ayvens.be] INFO: Scrape type for 1980503: 1
2026-03-24 22:56:33 [ayvens.be] INFO: Extracting data for car ID: 1980503
2026-03-24 22:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1980503
2026-03-24 22:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with scrape type 1
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/1.jpg not downloaded yet
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/2.jpg not downloaded yet
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009871190>
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/3.jpg saved to cache
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc75d0>
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/4.jpg saved to cache
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/3.jpg not downloaded yet
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/4.jpg not downloaded yet
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f8c90>
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/5.jpg saved to cache
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978bd90>
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/6.jpg saved to cache
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00c8f5d10>
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/7.jpg saved to cache
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/5.jpg not downloaded yet
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/6.jpg not downloaded yet
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970e710>
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/8.jpg saved to cache
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/7.jpg not downloaded yet
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/8.jpg not downloaded yet
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946d350>
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/9.jpg saved to cache
2026-03-24 22:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405b10>
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cl%252F6f5025128b0e42ebb815580eba8a2138%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/10.jpg saved to cache
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89a98301-746b-5629-a92d-24d79beff483
2026-03-24 22:56:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89a98301-746b-5629-a92d-24d79beff483, skipping ID generation
2026-03-24 22:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a98301-746b-5629-a92d-24d79beff483 with scrape type 1
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89a98301-746b-5629-a92d-24d79beff483 sending to next pipeline
2026-03-24 22:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 89a98301-746b-5629-a92d-24d79beff483, identifier: 1980502
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/9.jpg not downloaded yet
2026-03-24 22:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 89a98301-746b-5629-a92d-24d79beff483 with identifier: 1980502
2026-03-24 22:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 89a98301-746b-5629-a92d-24d79beff483 with identifier: 1980502
2026-03-24 22:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 89a98301-746b-5629-a92d-24d79beff483 with identifier: 1980502 to the API
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '89a98301-746b-5629-a92d-24d79beff483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 77722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a98301-746b-5629-a92d-24d79beff483/89a98301-746b-5629-a92d-24d79beff483_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cl/6f5025128b0e42ebb815580eba8a2138/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 2.0 A 180 D BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 A 180 D BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980502%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [ayvens.be] INFO: Saving data for 1980502: {'created_time': 1774392994.445317, 'last_price_update_time': 1774392994.445327, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980502') HTTP/1.1" 204 0
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/10.jpg not downloaded yet
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7410>
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/1.jpg saved to cache
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6710>
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/2.jpg saved to cache
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:34 [ayvens.be] INFO: Found listing with ID: 1980504
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980504%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [ayvens.be] INFO: Scrape type for 1980504: 1
2026-03-24 22:56:34 [ayvens.be] INFO: Extracting data for car ID: 1980504
2026-03-24 22:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b228193-ed00-578f-b827-fc5266b7ddc0 with identifier: 1980504
2026-03-24 22:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b228193-ed00-578f-b827-fc5266b7ddc0 with scrape type 1
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/1.jpg not downloaded yet
2026-03-24 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/2.jpg not downloaded yet
2026-03-24 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/3.jpg not downloaded yet
2026-03-24 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/4.jpg not downloaded yet
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/5.jpg not downloaded yet
2026-03-24 22:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/6.jpg not downloaded yet
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009397110>
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/6.jpg saved to cache
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/7.jpg not downloaded yet
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/8.jpg not downloaded yet
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1250>
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/5.jpg saved to cache
2026-03-24 22:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c1850>
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/3.jpg saved to cache
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb02d0>
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/4.jpg saved to cache
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091accd0>
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/7.jpg saved to cache
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb0a90>
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/8.jpg saved to cache
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/9.jpg not downloaded yet
2026-03-24 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd290>
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/9.jpg saved to cache
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/10.jpg not downloaded yet
2026-03-24 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:35 [ayvens.be] INFO: Found listing with ID: 1980505
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980505%27 HTTP/1.1" 200 None
2026-03-24 22:56:35 [ayvens.be] INFO: Scrape type for 1980505: 1
2026-03-24 22:56:35 [ayvens.be] INFO: Extracting data for car ID: 1980505
2026-03-24 22:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5fcacad-3aa7-52cc-8512-022af3058dd6 with identifier: 1980505
2026-03-24 22:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fcacad-3aa7-52cc-8512-022af3058dd6 with scrape type 1
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/1.jpg not downloaded yet
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/2.jpg not downloaded yet
2026-03-24 22:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009141450>
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F4f6b1713e4ff4d9da3cff1f4b2643467%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/10.jpg saved to cache
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed
2026-03-24 22:56:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed, skipping ID generation
2026-03-24 22:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with scrape type 1
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed sending to next pipeline
2026-03-24 22:56:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed, identifier: 1980503
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/3.jpg not downloaded yet
2026-03-24 22:56:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1980503
2026-03-24 22:56:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1980503
2026-03-24 22:56:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed with identifier: 1980503 to the API
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 100444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed/1a1e8f7a-cfd5-5e93-972a-c31d8d2ba8ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/4f6b1713e4ff4d9da3cff1f4b2643467/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980503%27 HTTP/1.1" 200 None
2026-03-24 22:56:36 [ayvens.be] INFO: Saving data for 1980503: {'created_time': 1774392996.019643, 'last_price_update_time': 1774392996.019653, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980503') HTTP/1.1" 204 0
2026-03-24 22:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/4.jpg not downloaded yet
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009771890>
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/1.jpg saved to cache
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009491510>
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/2.jpg saved to cache
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971a310>
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/5.jpg saved to cache
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/5.jpg not downloaded yet
2026-03-24 22:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d5010>
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/4.jpg saved to cache
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008371a90>
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/3.jpg saved to cache
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/6.jpg not downloaded yet
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/7.jpg not downloaded yet
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/8.jpg not downloaded yet
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098dfb50>
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/6.jpg saved to cache
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093daf90>
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/7.jpg saved to cache
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/9.jpg not downloaded yet
2026-03-24 22:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/10.jpg not downloaded yet
2026-03-24 22:56:36 [ayvens.be] INFO: Found listing with ID: 1980506
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980506%27 HTTP/1.1" 200 None
2026-03-24 22:56:36 [ayvens.be] INFO: Scrape type for 1980506: 1
2026-03-24 22:56:36 [ayvens.be] INFO: Extracting data for car ID: 1980506
2026-03-24 22:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with identifier: 1980506
2026-03-24 22:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with scrape type 1
2026-03-24 22:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/1.jpg not downloaded yet
2026-03-24 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/2.jpg not downloaded yet
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094437d0>
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/10.jpg saved to cache
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/3.jpg not downloaded yet
2026-03-24 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/4.jpg not downloaded yet
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4710>
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/8.jpg saved to cache
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009706450>
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gb%252F15205fb242544fee9fc9c3dc8a0d100e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/9.jpg saved to cache
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b228193-ed00-578f-b827-fc5266b7ddc0
2026-03-24 22:56:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b228193-ed00-578f-b827-fc5266b7ddc0, skipping ID generation
2026-03-24 22:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b228193-ed00-578f-b827-fc5266b7ddc0 with scrape type 1
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b228193-ed00-578f-b827-fc5266b7ddc0 sending to next pipeline
2026-03-24 22:56:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b228193-ed00-578f-b827-fc5266b7ddc0, identifier: 1980504
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdbc90>
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/1.jpg saved to cache
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d7c50>
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/2.jpg saved to cache
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/5.jpg not downloaded yet
2026-03-24 22:56:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b228193-ed00-578f-b827-fc5266b7ddc0 with identifier: 1980504
2026-03-24 22:56:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b228193-ed00-578f-b827-fc5266b7ddc0 with identifier: 1980504
2026-03-24 22:56:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b228193-ed00-578f-b827-fc5266b7ddc0 with identifier: 1980504 to the API
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b228193-ed00-578f-b827-fc5266b7ddc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 39939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 852187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b228193-ed00-578f-b827-fc5266b7ddc0/1b228193-ed00-578f-b827-fc5266b7ddc0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gb/15205fb242544fee9fc9c3dc8a0d100e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5 PHEV 225KW STYLE PLUS E-CVT 4WD',
 'transmission': 'automatic',
 'trim': '2.5 PHEV 225KW STYLE PLUS E-CVT 4WD',
 'vin': None,
 'year': 2024}
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980504%27 HTTP/1.1" 200 None
2026-03-24 22:56:37 [ayvens.be] INFO: Saving data for 1980504: {'created_time': 1774392997.933668, 'last_price_update_time': 1774392997.93368, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980504') HTTP/1.1" 204 0
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/6.jpg not downloaded yet
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760810>
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/3.jpg saved to cache
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643290>
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/4.jpg saved to cache
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098621d0>
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/5.jpg saved to cache
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/7.jpg not downloaded yet
2026-03-24 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/8.jpg not downloaded yet
2026-03-24 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/9.jpg not downloaded yet
2026-03-24 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/10.jpg not downloaded yet
2026-03-24 22:56:38 [ayvens.be] INFO: Found listing with ID: 1980507
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980507%27 HTTP/1.1" 200 None
2026-03-24 22:56:38 [ayvens.be] INFO: Scrape type for 1980507: 1
2026-03-24 22:56:38 [ayvens.be] INFO: Extracting data for car ID: 1980507
2026-03-24 22:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6125ccd-d4b3-506e-acae-78a769f08fc6 with identifier: 1980507
2026-03-24 22:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6125ccd-d4b3-506e-acae-78a769f08fc6 with scrape type 1
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/1.jpg not downloaded yet
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/2.jpg not downloaded yet
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/3.jpg not downloaded yet
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761e90>
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/7.jpg saved to cache
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00975a9d0>
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/9.jpg saved to cache
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bf010>
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/8.jpg saved to cache
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009685f90>
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/10.jpg saved to cache
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f95d0>
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/2.jpg saved to cache
2026-03-24 22:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093da550>
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0522816fa5d04a53be21114eb4ddc213%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/6.jpg saved to cache
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5fcacad-3aa7-52cc-8512-022af3058dd6
2026-03-24 22:56:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5fcacad-3aa7-52cc-8512-022af3058dd6, skipping ID generation
2026-03-24 22:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fcacad-3aa7-52cc-8512-022af3058dd6 with scrape type 1
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5fcacad-3aa7-52cc-8512-022af3058dd6 sending to next pipeline
2026-03-24 22:56:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f5fcacad-3aa7-52cc-8512-022af3058dd6, identifier: 1980505
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913fd50>
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/1.jpg saved to cache
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f5fcacad-3aa7-52cc-8512-022af3058dd6 with identifier: 1980505
2026-03-24 22:56:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f5fcacad-3aa7-52cc-8512-022af3058dd6 with identifier: 1980505
2026-03-24 22:56:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f5fcacad-3aa7-52cc-8512-022af3058dd6 with identifier: 1980505 to the API
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f5fcacad-3aa7-52cc-8512-022af3058dd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 98914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fcacad-3aa7-52cc-8512-022af3058dd6/f5fcacad-3aa7-52cc-8512-022af3058dd6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0522816fa5d04a53be21114eb4ddc213/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980505%27 HTTP/1.1" 200 None
2026-03-24 22:56:39 [ayvens.be] INFO: Saving data for 1980505: {'created_time': 1774392999.50991, 'last_price_update_time': 1774392999.509919, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980505') HTTP/1.1" 204 0
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/4.jpg not downloaded yet
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/5.jpg not downloaded yet
2026-03-24 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009612a10>
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/5.jpg saved to cache
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/6.jpg not downloaded yet
2026-03-24 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/7.jpg not downloaded yet
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/8.jpg not downloaded yet
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ee6d0>
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/4.jpg saved to cache
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/9.jpg not downloaded yet
2026-03-24 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/10.jpg not downloaded yet
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f1f10>
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/7.jpg saved to cache
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cc2d0>
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/6.jpg saved to cache
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911b210>
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/8.jpg saved to cache
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098dfa50>
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/3.jpg saved to cache
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:40 [ayvens.be] INFO: Found listing with ID: 1980508
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980508%27 HTTP/1.1" 200 None
2026-03-24 22:56:40 [ayvens.be] INFO: Scrape type for 1980508: 1
2026-03-24 22:56:40 [ayvens.be] INFO: Extracting data for car ID: 1980508
2026-03-24 22:56:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc55a80c-dc69-57db-a80d-38f2613468b1 with identifier: 1980508
2026-03-24 22:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc55a80c-dc69-57db-a80d-38f2613468b1 with scrape type 1
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/1.jpg not downloaded yet
2026-03-24 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/2.jpg not downloaded yet
2026-03-24 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/3.jpg not downloaded yet
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422cd0>
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/9.jpg saved to cache
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009448910>
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F730aec32ba024bd3b4cdf3a68e776576%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/10.jpg saved to cache
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb
2026-03-24 22:56:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb, skipping ID generation
2026-03-24 22:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with scrape type 1
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb sending to next pipeline
2026-03-24 22:56:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb, identifier: 1980506
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009610e50>
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/1.jpg saved to cache
2026-03-24 22:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with identifier: 1980506
2026-03-24 22:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with identifier: 1980506
2026-03-24 22:56:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb with identifier: 1980506 to the API
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE BERLINE',
 'odometer': 68306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb/1d8dbcb1-ebc2-51f8-922a-4ec3035d80bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/730aec32ba024bd3b4cdf3a68e776576/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE BERLINE 1.6 E-TECH 160 PHEV INTENS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 160 PHEV INTENS',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980506%27 HTTP/1.1" 200 None
2026-03-24 22:56:41 [ayvens.be] INFO: Saving data for 1980506: {'created_time': 1774393001.03101, 'last_price_update_time': 1774393001.03102, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980506') HTTP/1.1" 204 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/4.jpg not downloaded yet
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009942450>
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/5.jpg saved to cache
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1e10>
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/6.jpg saved to cache
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7490>
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/2.jpg saved to cache
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/5.jpg not downloaded yet
2026-03-24 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3990>
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/4.jpg saved to cache
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/6.jpg not downloaded yet
2026-03-24 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/7.jpg not downloaded yet
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098deb90>
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/3.jpg saved to cache
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009156750>
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/8.jpg saved to cache
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4290>
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/7.jpg saved to cache
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/8.jpg not downloaded yet
2026-03-24 22:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008383850>
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/10.jpg saved to cache
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3590>
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbd516442127d4c8d8053f32dd5c374e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/9.jpg saved to cache
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6125ccd-d4b3-506e-acae-78a769f08fc6
2026-03-24 22:56:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6125ccd-d4b3-506e-acae-78a769f08fc6, skipping ID generation
2026-03-24 22:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6125ccd-d4b3-506e-acae-78a769f08fc6 with scrape type 1
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6125ccd-d4b3-506e-acae-78a769f08fc6 sending to next pipeline
2026-03-24 22:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a6125ccd-d4b3-506e-acae-78a769f08fc6, identifier: 1980507
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/9.jpg not downloaded yet
2026-03-24 22:56:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a6125ccd-d4b3-506e-acae-78a769f08fc6 with identifier: 1980507
2026-03-24 22:56:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a6125ccd-d4b3-506e-acae-78a769f08fc6 with identifier: 1980507
2026-03-24 22:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a6125ccd-d4b3-506e-acae-78a769f08fc6 with identifier: 1980507 to the API
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a6125ccd-d4b3-506e-acae-78a769f08fc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 79130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6125ccd-d4b3-506e-acae-78a769f08fc6/a6125ccd-d4b3-506e-acae-78a769f08fc6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bd516442127d4c8d8053f32dd5c374e7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980507%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [ayvens.be] INFO: Saving data for 1980507: {'created_time': 1774393002.237131, 'last_price_update_time': 1774393002.237141, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980507') HTTP/1.1" 204 0
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/10.jpg not downloaded yet
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fb8d0>
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/1.jpg saved to cache
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [ayvens.be] INFO: Found listing with ID: 1980509
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980509%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [ayvens.be] INFO: Scrape type for 1980509: 1
2026-03-24 22:56:42 [ayvens.be] INFO: Extracting data for car ID: 1980509
2026-03-24 22:56:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1980509
2026-03-24 22:56:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf with scrape type 1
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/1.jpg not downloaded yet
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/2.jpg not downloaded yet
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091196d0>
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/2.jpg saved to cache
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/3.jpg not downloaded yet
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/4.jpg not downloaded yet
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f2510>
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/3.jpg saved to cache
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009448c90>
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/5.jpg saved to cache
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019350>
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/4.jpg saved to cache
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/5.jpg not downloaded yet
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/6.jpg not downloaded yet
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/7.jpg not downloaded yet
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/8.jpg not downloaded yet
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/9.jpg not downloaded yet
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/10.jpg not downloaded yet
2026-03-24 22:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009566e10>
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/6.jpg saved to cache
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:43 [ayvens.be] INFO: Found listing with ID: 1980510
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980510%27 HTTP/1.1" 200 None
2026-03-24 22:56:43 [ayvens.be] INFO: Scrape type for 1980510: 1
2026-03-24 22:56:43 [ayvens.be] INFO: Extracting data for car ID: 1980510
2026-03-24 22:56:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1980510
2026-03-24 22:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with scrape type 1
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/1.jpg not downloaded yet
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/2.jpg not downloaded yet
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008313d90>
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/7.jpg saved to cache
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d66d0>
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/10.jpg saved to cache
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a9b90>
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/1.jpg saved to cache
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a29cd0>
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/8.jpg saved to cache
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664bd0>
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/2.jpg saved to cache
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4450>
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cb%252Ff9ced2f458e148629184a73189bfe36e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/9.jpg saved to cache
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc55a80c-dc69-57db-a80d-38f2613468b1
2026-03-24 22:56:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc55a80c-dc69-57db-a80d-38f2613468b1, skipping ID generation
2026-03-24 22:56:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc55a80c-dc69-57db-a80d-38f2613468b1 with scrape type 1
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc55a80c-dc69-57db-a80d-38f2613468b1 sending to next pipeline
2026-03-24 22:56:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fc55a80c-dc69-57db-a80d-38f2613468b1, identifier: 1980508
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/3.jpg not downloaded yet
2026-03-24 22:56:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fc55a80c-dc69-57db-a80d-38f2613468b1 with identifier: 1980508
2026-03-24 22:56:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fc55a80c-dc69-57db-a80d-38f2613468b1 with identifier: 1980508
2026-03-24 22:56:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fc55a80c-dc69-57db-a80d-38f2613468b1 with identifier: 1980508 to the API
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'DENIMBLAUW',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fc55a80c-dc69-57db-a80d-38f2613468b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 102962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc55a80c-dc69-57db-a80d-38f2613468b1/fc55a80c-dc69-57db-a80d-38f2613468b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cb/f9ced2f458e148629184a73189bfe36e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980508%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [ayvens.be] INFO: Saving data for 1980508: {'created_time': 1774393004.225735, 'last_price_update_time': 1774393004.225744, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980508') HTTP/1.1" 204 0
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/4.jpg not downloaded yet
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/5.jpg not downloaded yet
2026-03-24 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/6.jpg not downloaded yet
2026-03-24 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/7.jpg not downloaded yet
2026-03-24 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009175a50>
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/5.jpg saved to cache
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/8.jpg not downloaded yet
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/9.jpg not downloaded yet
2026-03-24 22:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/10.jpg not downloaded yet
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f3d0>
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/7.jpg saved to cache
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008372610>
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/3.jpg saved to cache
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:44 [ayvens.be] INFO: Found listing with ID: 1980511
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980511%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [ayvens.be] INFO: Scrape type for 1980511: 1
2026-03-24 22:56:44 [ayvens.be] INFO: Extracting data for car ID: 1980511
2026-03-24 22:56:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1980511
2026-03-24 22:56:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with scrape type 1
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/1.jpg not downloaded yet
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8990>
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/4.jpg saved to cache
2026-03-24 22:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945e610>
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/1.jpg saved to cache
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/2.jpg not downloaded yet
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6f50>
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/6.jpg saved to cache
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097719d0>
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/8.jpg saved to cache
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641590>
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/10.jpg saved to cache
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/3.jpg not downloaded yet
2026-03-24 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/4.jpg not downloaded yet
2026-03-24 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/5.jpg not downloaded yet
2026-03-24 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/6.jpg not downloaded yet
2026-03-24 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/7.jpg not downloaded yet
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/8.jpg not downloaded yet
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/9.jpg not downloaded yet
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1950>
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/5.jpg saved to cache
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/10.jpg not downloaded yet
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009612bd0>
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/6.jpg saved to cache
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6f50>
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dn%252F1119a9effba5497189756c74f22b6374%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/9.jpg saved to cache
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf
2026-03-24 22:56:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b4a4a85-7e3f-53c3-a306-36048b1efecf, skipping ID generation
2026-03-24 22:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf with scrape type 1
2026-03-24 22:56:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b4a4a85-7e3f-53c3-a306-36048b1efecf sending to next pipeline
2026-03-24 22:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9b4a4a85-7e3f-53c3-a306-36048b1efecf, identifier: 1980509
2026-03-24 22:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1980509
2026-03-24 22:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1980509
2026-03-24 22:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9b4a4a85-7e3f-53c3-a306-36048b1efecf with identifier: 1980509 to the API
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '9b4a4a85-7e3f-53c3-a306-36048b1efecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 68892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b4a4a85-7e3f-53c3-a306-36048b1efecf/9b4a4a85-7e3f-53c3-a306-36048b1efecf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dn/1119a9effba5497189756c74f22b6374/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW',
 'vin': None,
 'year': 2023}
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980509%27 HTTP/1.1" 200 None
2026-03-24 22:56:46 [ayvens.be] INFO: Saving data for 1980509: {'created_time': 1774393006.271883, 'last_price_update_time': 1774393006.271892, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980509') HTTP/1.1" 204 0
2026-03-24 22:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:46 [ayvens.be] INFO: Found listing with ID: 1980512
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980512%27 HTTP/1.1" 200 None
2026-03-24 22:56:46 [ayvens.be] INFO: Scrape type for 1980512: 1
2026-03-24 22:56:46 [ayvens.be] INFO: Extracting data for car ID: 1980512
2026-03-24 22:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c5f1b7-f76b-5482-aef6-7084eeacf1f3 with identifier: 1980512
2026-03-24 22:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3 with scrape type 1
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/1.jpg not downloaded yet
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009687a10>
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/2.jpg saved to cache
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788910>
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/3.jpg saved to cache
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d9950>
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/7.jpg saved to cache
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910f9d0>
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/8.jpg saved to cache
2026-03-24 22:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d6550>
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/4.jpg saved to cache
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb0cd0>
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/9.jpg saved to cache
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/2.jpg not downloaded yet
2026-03-24 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/3.jpg not downloaded yet
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c09d0>
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fe0fca2b45c3a458f82db13cbd037b988%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/10.jpg saved to cache
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8
2026-03-24 22:56:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8, skipping ID generation
2026-03-24 22:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with scrape type 1
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 sending to next pipeline
2026-03-24 22:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8, identifier: 1980510
2026-03-24 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1980510
2026-03-24 22:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1980510
2026-03-24 22:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 18979b1a-ad2b-58fb-9f7b-baea2c3543a8 with identifier: 1980510 to the API
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '18979b1a-ad2b-58fb-9f7b-baea2c3543a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 83182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643594,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18979b1a-ad2b-58fb-9f7b-baea2c3543a8/18979b1a-ad2b-58fb-9f7b-baea2c3543a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/e0fca2b45c3a458f82db13cbd037b988/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980510%27 HTTP/1.1" 200 None
2026-03-24 22:56:47 [ayvens.be] INFO: Saving data for 1980510: {'created_time': 1774393007.706647, 'last_price_update_time': 1774393007.706657, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980510') HTTP/1.1" 204 0
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/4.jpg not downloaded yet
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/5.jpg not downloaded yet
2026-03-24 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a4d10>
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/1.jpg saved to cache
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912b010>
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/5.jpg saved to cache
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce790>
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/2.jpg saved to cache
2026-03-24 22:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4850>
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/6.jpg saved to cache
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/6.jpg not downloaded yet
2026-03-24 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/7.jpg not downloaded yet
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963bf10>
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/3.jpg saved to cache
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946fad0>
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/7.jpg saved to cache
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/8.jpg not downloaded yet
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/9.jpg not downloaded yet
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083824d0>
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/4.jpg saved to cache
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a0050>
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/10.jpg saved to cache
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed0090>
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/9.jpg saved to cache
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd850>
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F57fb4cb54eeb4126924242c92961b9de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/8.jpg saved to cache
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0
2026-03-24 22:56:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0, skipping ID generation
2026-03-24 22:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with scrape type 1
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 sending to next pipeline
2026-03-24 22:56:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0, identifier: 1980511
2026-03-24 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1980511
2026-03-24 22:56:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1980511
2026-03-24 22:56:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0 with identifier: 1980511 to the API
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 157391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0/5ff800f9-8b1c-5e6b-8b11-9fc2a2688fd0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/57fb4cb54eeb4126924242c92961b9de/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 1.5 ECOBLUE 88KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 ECOBLUE 88KW TITANIUM',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980511%27 HTTP/1.1" 200 None
2026-03-24 22:56:48 [ayvens.be] INFO: Saving data for 1980511: {'created_time': 1774393008.872808, 'last_price_update_time': 1774393008.872818, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980511') HTTP/1.1" 204 0
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/10.jpg not downloaded yet
2026-03-24 22:56:48 [ayvens.be] INFO: Found listing with ID: 1980513
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980513%27 HTTP/1.1" 200 None
2026-03-24 22:56:48 [ayvens.be] INFO: Scrape type for 1980513: 1
2026-03-24 22:56:48 [ayvens.be] INFO: Extracting data for car ID: 1980513
2026-03-24 22:56:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1980513
2026-03-24 22:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with scrape type 1
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/1.jpg not downloaded yet
2026-03-24 22:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830b790>
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/1.jpg saved to cache
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/2.jpg not downloaded yet
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/3.jpg not downloaded yet
2026-03-24 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/4.jpg not downloaded yet
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009703850>
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/2.jpg saved to cache
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/5.jpg not downloaded yet
2026-03-24 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/6.jpg not downloaded yet
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009dae150>
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/4.jpg saved to cache
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/7.jpg not downloaded yet
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/8.jpg not downloaded yet
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094ab990>
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/3.jpg saved to cache
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639a50>
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/7.jpg saved to cache
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008313650>
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/5.jpg saved to cache
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/9.jpg not downloaded yet
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008315a90>
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/6.jpg saved to cache
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/10.jpg not downloaded yet
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121890>
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/8.jpg saved to cache
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:49 [ayvens.be] INFO: Found listing with ID: 1980514
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980514%27 HTTP/1.1" 200 None
2026-03-24 22:56:49 [ayvens.be] INFO: Scrape type for 1980514: 1
2026-03-24 22:56:49 [ayvens.be] INFO: Extracting data for car ID: 1980514
2026-03-24 22:56:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1980514
2026-03-24 22:56:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f513ab40-e80d-5508-9312-ecf3faf2e7c3 with scrape type 1
2026-03-24 22:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/1.jpg not downloaded yet
2026-03-24 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/2.jpg not downloaded yet
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bb690>
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/9.jpg saved to cache
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/3.jpg not downloaded yet
2026-03-24 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/4.jpg not downloaded yet
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008316310>
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F701388fc3b1f4377b2c275f50ed8cb75%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/10.jpg saved to cache
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3
2026-03-24 22:56:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96c5f1b7-f76b-5482-aef6-7084eeacf1f3, skipping ID generation
2026-03-24 22:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3 with scrape type 1
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96c5f1b7-f76b-5482-aef6-7084eeacf1f3 sending to next pipeline
2026-03-24 22:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 96c5f1b7-f76b-5482-aef6-7084eeacf1f3, identifier: 1980512
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959d550>
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/1.jpg saved to cache
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/5.jpg not downloaded yet
2026-03-24 22:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 96c5f1b7-f76b-5482-aef6-7084eeacf1f3 with identifier: 1980512
2026-03-24 22:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 96c5f1b7-f76b-5482-aef6-7084eeacf1f3 with identifier: 1980512
2026-03-24 22:56:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 96c5f1b7-f76b-5482-aef6-7084eeacf1f3 with identifier: 1980512 to the API
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '96c5f1b7-f76b-5482-aef6-7084eeacf1f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA DIESEL - 2020',
 'odometer': 124876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 912345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 945645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c5f1b7-f76b-5482-aef6-7084eeacf1f3/96c5f1b7-f76b-5482-aef6-7084eeacf1f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/701388fc3b1f4377b2c275f50ed8cb75/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA DIESEL - 2020 1.5 TDCi EB FWD Titanium',
 'transmission': 'automatic',
 'trim': '1.5 TDCi EB FWD Titanium',
 'vin': None,
 'year': 2021}
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980512%27 HTTP/1.1" 200 None
2026-03-24 22:56:50 [ayvens.be] INFO: Saving data for 1980512: {'created_time': 1774393010.796526, 'last_price_update_time': 1774393010.796535, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980512') HTTP/1.1" 204 0
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/6.jpg not downloaded yet
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083264d0>
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/3.jpg saved to cache
2026-03-24 22:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967e6d0>
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/4.jpg saved to cache
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e390>
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/5.jpg saved to cache
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967ced0>
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/2.jpg saved to cache
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/7.jpg not downloaded yet
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083709d0>
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/6.jpg saved to cache
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/8.jpg not downloaded yet
2026-03-24 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/9.jpg not downloaded yet
2026-03-24 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/10.jpg not downloaded yet
2026-03-24 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:51 [ayvens.be] INFO: Found listing with ID: 1980515
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980515%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [ayvens.be] INFO: Scrape type for 1980515: 1
2026-03-24 22:56:51 [ayvens.be] INFO: Extracting data for car ID: 1980515
2026-03-24 22:56:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7551471-f08e-501d-a622-73728074b450 with identifier: 1980515
2026-03-24 22:56:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7551471-f08e-501d-a622-73728074b450 with scrape type 1
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/1.jpg not downloaded yet
2026-03-24 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/2.jpg not downloaded yet
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/3.jpg not downloaded yet
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3f50>
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/7.jpg saved to cache
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b726510>
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/9.jpg saved to cache
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/4.jpg not downloaded yet
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1a8a10>
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/10.jpg saved to cache
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/5.jpg not downloaded yet
2026-03-24 22:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bce50>
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/2.jpg saved to cache
2026-03-24 22:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945c990>
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/1.jpg saved to cache
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d947d0>
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gv%252F769554b8e05b4b76b5b9588f08574db2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/8.jpg saved to cache
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9
2026-03-24 22:56:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9, skipping ID generation
2026-03-24 22:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with scrape type 1
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 sending to next pipeline
2026-03-24 22:56:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9, identifier: 1980513
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009129350>
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/3.jpg saved to cache
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914d410>
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/5.jpg saved to cache
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/6.jpg not downloaded yet
2026-03-24 22:56:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1980513
2026-03-24 22:56:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1980513
2026-03-24 22:56:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 010c1aea-c107-5cbc-ab3b-b1ae80957cb9 with identifier: 1980513 to the API
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '010c1aea-c107-5cbc-ab3b-b1ae80957cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX2',
 'odometer': 7987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010c1aea-c107-5cbc-ab3b-b1ae80957cb9/010c1aea-c107-5cbc-ab3b-b1ae80957cb9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gv/769554b8e05b4b76b5b9588f08574db2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX2 BEV 67KWH EDRIVE20 150KW',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EDRIVE20 150KW',
 'vin': None,
 'year': 2025}
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980513%27 HTTP/1.1" 200 None
2026-03-24 22:56:52 [ayvens.be] INFO: Saving data for 1980513: {'created_time': 1774393012.705082, 'last_price_update_time': 1774393012.705091, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980513') HTTP/1.1" 204 0
2026-03-24 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/7.jpg not downloaded yet
2026-03-24 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/8.jpg not downloaded yet
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095fa090>
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/6.jpg saved to cache
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/9.jpg not downloaded yet
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/10.jpg not downloaded yet
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b53d0>
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/4.jpg saved to cache
2026-03-24 22:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345e90>
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/7.jpg saved to cache
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959d2d0>
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/10.jpg saved to cache
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:53 [ayvens.be] INFO: Found listing with ID: 1980516
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980516%27 HTTP/1.1" 200 None
2026-03-24 22:56:53 [ayvens.be] INFO: Scrape type for 1980516: 1
2026-03-24 22:56:53 [ayvens.be] INFO: Extracting data for car ID: 1980516
2026-03-24 22:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db6a9576-4990-54e1-bf3d-0584456e377f with identifier: 1980516
2026-03-24 22:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6a9576-4990-54e1-bf3d-0584456e377f with scrape type 1
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/1.jpg not downloaded yet
2026-03-24 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/2.jpg not downloaded yet
2026-03-24 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/3.jpg not downloaded yet
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008346350>
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/9.jpg saved to cache
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2be50>
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8fde6e1b558644d69f7c3c18b3360a62%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/8.jpg saved to cache
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f513ab40-e80d-5508-9312-ecf3faf2e7c3
2026-03-24 22:56:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f513ab40-e80d-5508-9312-ecf3faf2e7c3, skipping ID generation
2026-03-24 22:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f513ab40-e80d-5508-9312-ecf3faf2e7c3 with scrape type 1
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f513ab40-e80d-5508-9312-ecf3faf2e7c3 sending to next pipeline
2026-03-24 22:56:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f513ab40-e80d-5508-9312-ecf3faf2e7c3, identifier: 1980514
2026-03-24 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1980514
2026-03-24 22:56:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1980514
2026-03-24 22:56:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f513ab40-e80d-5508-9312-ecf3faf2e7c3 with identifier: 1980514 to the API
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f513ab40-e80d-5508-9312-ecf3faf2e7c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 114644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f513ab40-e80d-5508-9312-ecf3faf2e7c3/f513ab40-e80d-5508-9312-ecf3faf2e7c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8fde6e1b558644d69f7c3c18b3360a62/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980514%27 HTTP/1.1" 200 None
2026-03-24 22:56:53 [ayvens.be] INFO: Saving data for 1980514: {'created_time': 1774393013.776668, 'last_price_update_time': 1774393013.776678, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980514') HTTP/1.1" 204 0
2026-03-24 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/4.jpg not downloaded yet
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/5.jpg not downloaded yet
2026-03-24 22:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009192750>
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/2.jpg saved to cache
2026-03-24 22:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009423010>
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/3.jpg saved to cache
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097041d0>
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/4.jpg saved to cache
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008308a10>
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/1.jpg saved to cache
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/6.jpg not downloaded yet
2026-03-24 22:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/7.jpg not downloaded yet
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b78990>
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/5.jpg saved to cache
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c28d0>
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/6.jpg saved to cache
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/8.jpg not downloaded yet
2026-03-24 22:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/9.jpg not downloaded yet
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f2010>
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/7.jpg saved to cache
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093dbb50>
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/8.jpg saved to cache
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/10.jpg not downloaded yet
2026-03-24 22:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4c50>
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/10.jpg saved to cache
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009943110>
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F96c2caa4ca624cf89627a2f22d51a7c7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/9.jpg saved to cache
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7551471-f08e-501d-a622-73728074b450
2026-03-24 22:56:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7551471-f08e-501d-a622-73728074b450, skipping ID generation
2026-03-24 22:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7551471-f08e-501d-a622-73728074b450 with scrape type 1
2026-03-24 22:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7551471-f08e-501d-a622-73728074b450 sending to next pipeline
2026-03-24 22:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7551471-f08e-501d-a622-73728074b450, identifier: 1980515
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836a990>
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/1.jpg saved to cache
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:55 [ayvens.be] INFO: Found listing with ID: 1980517
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980517%27 HTTP/1.1" 200 None
2026-03-24 22:56:55 [ayvens.be] INFO: Scrape type for 1980517: 1
2026-03-24 22:56:55 [ayvens.be] INFO: Extracting data for car ID: 1980517
2026-03-24 22:56:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20549fbf-58df-55b4-930d-2914ab2f0ad6 with identifier: 1980517
2026-03-24 22:56:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20549fbf-58df-55b4-930d-2914ab2f0ad6 with scrape type 1
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/1.jpg not downloaded yet
2026-03-24 22:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7551471-f08e-501d-a622-73728074b450 with identifier: 1980515
2026-03-24 22:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7551471-f08e-501d-a622-73728074b450 with identifier: 1980515
2026-03-24 22:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7551471-f08e-501d-a622-73728074b450 with identifier: 1980515 to the API
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e7551471-f08e-501d-a622-73728074b450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 157440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7551471-f08e-501d-a622-73728074b450/e7551471-f08e-501d-a622-73728074b450_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/96c2caa4ca624cf89627a2f22d51a7c7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980515%27 HTTP/1.1" 200 None
2026-03-24 22:56:55 [ayvens.be] INFO: Saving data for 1980515: {'created_time': 1774393015.417153, 'last_price_update_time': 1774393015.417162, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980515') HTTP/1.1" 204 0
2026-03-24 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/2.jpg not downloaded yet
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187310>
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/2.jpg saved to cache
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/3.jpg not downloaded yet
2026-03-24 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/4.jpg not downloaded yet
2026-03-24 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/5.jpg not downloaded yet
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310850>
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/3.jpg saved to cache
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/6.jpg not downloaded yet
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/7.jpg not downloaded yet
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009193a10>
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/5.jpg saved to cache
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967f350>
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/4.jpg saved to cache
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cc550>
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/6.jpg saved to cache
2026-03-24 22:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910d410>
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/7.jpg saved to cache
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/8.jpg not downloaded yet
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962e790>
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/8.jpg saved to cache
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/9.jpg not downloaded yet
2026-03-24 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/10.jpg not downloaded yet
2026-03-24 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:56 [ayvens.be] INFO: Found listing with ID: 1980518
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980518%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [ayvens.be] INFO: Scrape type for 1980518: 1
2026-03-24 22:56:56 [ayvens.be] INFO: Extracting data for car ID: 1980518
2026-03-24 22:56:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af185355-7844-5b20-8600-3e62f970b76e with identifier: 1980518
2026-03-24 22:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af185355-7844-5b20-8600-3e62f970b76e with scrape type 1
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/1.jpg not downloaded yet
2026-03-24 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/2.jpg not downloaded yet
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/3.jpg not downloaded yet
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/4.jpg not downloaded yet
2026-03-24 22:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/5.jpg not downloaded yet
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098df6d0>
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/10.jpg saved to cache
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009703910>
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/1.jpg saved to cache
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/6.jpg not downloaded yet
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/7.jpg not downloaded yet
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c7910>
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/2.jpg saved to cache
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e250>
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/4.jpg saved to cache
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009492d50>
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/5.jpg saved to cache
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b4d0>
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/3.jpg saved to cache
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830a6d0>
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F73c09dc166a4436a8536944aac4af2d4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/9.jpg saved to cache
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db6a9576-4990-54e1-bf3d-0584456e377f
2026-03-24 22:56:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db6a9576-4990-54e1-bf3d-0584456e377f, skipping ID generation
2026-03-24 22:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6a9576-4990-54e1-bf3d-0584456e377f with scrape type 1
2026-03-24 22:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db6a9576-4990-54e1-bf3d-0584456e377f sending to next pipeline
2026-03-24 22:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: db6a9576-4990-54e1-bf3d-0584456e377f, identifier: 1980516
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959d0d0>
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/6.jpg saved to cache
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: db6a9576-4990-54e1-bf3d-0584456e377f with identifier: 1980516
2026-03-24 22:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: db6a9576-4990-54e1-bf3d-0584456e377f with identifier: 1980516
2026-03-24 22:56:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: db6a9576-4990-54e1-bf3d-0584456e377f with identifier: 1980516 to the API
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'db6a9576-4990-54e1-bf3d-0584456e377f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 147746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db6a9576-4990-54e1-bf3d-0584456e377f/db6a9576-4990-54e1-bf3d-0584456e377f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/73c09dc166a4436a8536944aac4af2d4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980516%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [ayvens.be] INFO: Saving data for 1980516: {'created_time': 1774393017.544639, 'last_price_update_time': 1774393017.54465, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980516') HTTP/1.1" 204 0
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/8.jpg not downloaded yet
2026-03-24 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/9.jpg not downloaded yet
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/10.jpg not downloaded yet
2026-03-24 22:56:57 [ayvens.be] INFO: Found listing with ID: 1980519
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980519%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [ayvens.be] INFO: Scrape type for 1980519: 1
2026-03-24 22:56:57 [ayvens.be] INFO: Extracting data for car ID: 1980519
2026-03-24 22:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with identifier: 1980519
2026-03-24 22:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with scrape type 1
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/1.jpg not downloaded yet
2026-03-24 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/2.jpg not downloaded yet
2026-03-24 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/3.jpg not downloaded yet
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009684c90>
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/7.jpg saved to cache
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/4.jpg not downloaded yet
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/5.jpg not downloaded yet
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/6.jpg not downloaded yet
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009790b10>
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/8.jpg saved to cache
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959ef10>
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/1.jpg saved to cache
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978a2d0>
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/9.jpg saved to cache
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959f890>
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/2.jpg saved to cache
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009839010>
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/3.jpg saved to cache
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097007d0>
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F2818f793b4844240bcc2558bc91fe06e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/10.jpg saved to cache
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20549fbf-58df-55b4-930d-2914ab2f0ad6
2026-03-24 22:56:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20549fbf-58df-55b4-930d-2914ab2f0ad6, skipping ID generation
2026-03-24 22:56:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20549fbf-58df-55b4-930d-2914ab2f0ad6 with scrape type 1
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20549fbf-58df-55b4-930d-2914ab2f0ad6 sending to next pipeline
2026-03-24 22:56:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 20549fbf-58df-55b4-930d-2914ab2f0ad6, identifier: 1980517
2026-03-24 22:56:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 20549fbf-58df-55b4-930d-2914ab2f0ad6 with identifier: 1980517
2026-03-24 22:56:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 20549fbf-58df-55b4-930d-2914ab2f0ad6 with identifier: 1980517
2026-03-24 22:56:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 20549fbf-58df-55b4-930d-2914ab2f0ad6 with identifier: 1980517 to the API
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '20549fbf-58df-55b4-930d-2914ab2f0ad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 77756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20549fbf-58df-55b4-930d-2914ab2f0ad6/20549fbf-58df-55b4-930d-2914ab2f0ad6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 926402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/2818f793b4844240bcc2558bc91fe06e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2023}
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980517%27 HTTP/1.1" 200 None
2026-03-24 22:56:58 [ayvens.be] INFO: Saving data for 1980517: {'created_time': 1774393018.902213, 'last_price_update_time': 1774393018.902223, 'auction_closing_time': 1774530000.0}
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980517') HTTP/1.1" 204 0
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/7.jpg not downloaded yet
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/8.jpg not downloaded yet
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd890>
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/4.jpg saved to cache
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/9.jpg not downloaded yet
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/10.jpg not downloaded yet
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [ayvens.be] INFO: Found listing with ID: 1980520
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980520%27 HTTP/1.1" 200 None
2026-03-24 22:56:59 [ayvens.be] INFO: Scrape type for 1980520: 1
2026-03-24 22:56:59 [ayvens.be] INFO: Extracting data for car ID: 1980520
2026-03-24 22:56:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1980520
2026-03-24 22:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cda1ee7-067d-5b55-a37f-ab40174ad128 with scrape type 1
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/1.jpg not downloaded yet
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/2.jpg not downloaded yet
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/3.jpg not downloaded yet
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd710>
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/5.jpg saved to cache
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/4.jpg not downloaded yet
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c71d0>
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/7.jpg saved to cache
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a9350>
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/1.jpg saved to cache
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bcd50>
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/6.jpg saved to cache
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/5.jpg not downloaded yet
2026-03-24 22:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/6.jpg not downloaded yet
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912a250>
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/8.jpg saved to cache
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3f10>
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/9.jpg saved to cache
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1e90>
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8d9dcb0be7324430942467d4606efb6b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/10.jpg saved to cache
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af185355-7844-5b20-8600-3e62f970b76e
2026-03-24 22:56:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af185355-7844-5b20-8600-3e62f970b76e, skipping ID generation
2026-03-24 22:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af185355-7844-5b20-8600-3e62f970b76e with scrape type 1
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af185355-7844-5b20-8600-3e62f970b76e sending to next pipeline
2026-03-24 22:56:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af185355-7844-5b20-8600-3e62f970b76e, identifier: 1980518
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915e050>
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/6.jpg saved to cache
2026-03-24 22:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4fd0>
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:56:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/3.jpg saved to cache
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1510>
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/5.jpg saved to cache
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:57:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af185355-7844-5b20-8600-3e62f970b76e with identifier: 1980518
2026-03-24 22:57:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af185355-7844-5b20-8600-3e62f970b76e with identifier: 1980518
2026-03-24 22:57:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: af185355-7844-5b20-8600-3e62f970b76e with identifier: 1980518 to the API
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'af185355-7844-5b20-8600-3e62f970b76e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 92176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 906242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 942203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af185355-7844-5b20-8600-3e62f970b76e/af185355-7844-5b20-8600-3e62f970b76e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8d9dcb0be7324430942467d4606efb6b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980518%27 HTTP/1.1" 200 None
2026-03-24 22:57:00 [ayvens.be] INFO: Saving data for 1980518: {'created_time': 1774393020.55969, 'last_price_update_time': 1774393020.559699, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980518') HTTP/1.1" 204 0
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/7.jpg not downloaded yet
2026-03-24 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009611010>
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/4.jpg saved to cache
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b9050>
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/2.jpg saved to cache
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/8.jpg not downloaded yet
2026-03-24 22:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/9.jpg not downloaded yet
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095be790>
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/9.jpg saved to cache
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/10.jpg not downloaded yet
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449b50>
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/7.jpg saved to cache
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0750>
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/8.jpg saved to cache
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:57:00 [ayvens.be] INFO: Found listing with ID: 1980521
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980521%27 HTTP/1.1" 200 None
2026-03-24 22:57:00 [ayvens.be] INFO: Scrape type for 1980521: 1
2026-03-24 22:57:00 [ayvens.be] INFO: Extracting data for car ID: 1980521
2026-03-24 22:57:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd27977-5860-50aa-b978-7bbb07fe7d81 with identifier: 1980521
2026-03-24 22:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd27977-5860-50aa-b978-7bbb07fe7d81 with scrape type 1
2026-03-24 22:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/1.jpg not downloaded yet
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830ae90>
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3f0c2463d08c4cf69a136dcd6b5159b9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/10.jpg saved to cache
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710
2026-03-24 22:57:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdc66ceb-0cf1-570b-bcc5-e95140bdc710, skipping ID generation
2026-03-24 22:57:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with scrape type 1
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdc66ceb-0cf1-570b-bcc5-e95140bdc710 sending to next pipeline
2026-03-24 22:57:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bdc66ceb-0cf1-570b-bcc5-e95140bdc710, identifier: 1980519
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/2.jpg not downloaded yet
2026-03-24 22:57:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with identifier: 1980519
2026-03-24 22:57:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with identifier: 1980519
2026-03-24 22:57:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bdc66ceb-0cf1-570b-bcc5-e95140bdc710 with identifier: 1980519 to the API
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bdc66ceb-0cf1-570b-bcc5-e95140bdc710',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 158805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc66ceb-0cf1-570b-bcc5-e95140bdc710/bdc66ceb-0cf1-570b-bcc5-e95140bdc710_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3f0c2463d08c4cf69a136dcd6b5159b9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980519%27 HTTP/1.1" 200 None
2026-03-24 22:57:01 [ayvens.be] INFO: Saving data for 1980519: {'created_time': 1774393021.575903, 'last_price_update_time': 1774393021.575914, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980519') HTTP/1.1" 204 0
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/3.jpg not downloaded yet
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914ed10>
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/2.jpg saved to cache
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613c90>
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/5.jpg saved to cache
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098391d0>
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/3.jpg saved to cache
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945de50>
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/4.jpg saved to cache
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/4.jpg not downloaded yet
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/5.jpg not downloaded yet
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/6.jpg not downloaded yet
2026-03-24 22:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/7.jpg not downloaded yet
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/8.jpg not downloaded yet
2026-03-24 22:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/9.jpg not downloaded yet
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c2210>
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/7.jpg saved to cache
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009131a10>
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/8.jpg saved to cache
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bc190>
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/6.jpg saved to cache
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/10.jpg not downloaded yet
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c2c90>
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/9.jpg saved to cache
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:02 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 600
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec5a10>
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/1.jpg saved to cache
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a750>
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F3915cb3dafc241b8a3ce9ed6ab0a9d3c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/10.jpg saved to cache
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cda1ee7-067d-5b55-a37f-ab40174ad128
2026-03-24 22:57:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4cda1ee7-067d-5b55-a37f-ab40174ad128, skipping ID generation
2026-03-24 22:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cda1ee7-067d-5b55-a37f-ab40174ad128 with scrape type 1
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4cda1ee7-067d-5b55-a37f-ab40174ad128 sending to next pipeline
2026-03-24 22:57:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4cda1ee7-067d-5b55-a37f-ab40174ad128, identifier: 1980520
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b61d0>
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/1.jpg saved to cache
2026-03-24 22:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:57:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1980520
2026-03-24 22:57:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1980520
2026-03-24 22:57:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4cda1ee7-067d-5b55-a37f-ab40174ad128 with identifier: 1980520 to the API
2026-03-24 22:57:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4cda1ee7-067d-5b55-a37f-ab40174ad128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 175265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4cda1ee7-067d-5b55-a37f-ab40174ad128/4cda1ee7-067d-5b55-a37f-ab40174ad128_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/3915cb3dafc241b8a3ce9ed6ab0a9d3c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980520%27 HTTP/1.1" 200 None
2026-03-24 22:57:03 [ayvens.be] INFO: Saving data for 1980520: {'created_time': 1774393023.116804, 'last_price_update_time': 1774393023.116816, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980520') HTTP/1.1" 204 0
2026-03-24 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cf890>
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/4.jpg saved to cache
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009120810>
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/2.jpg saved to cache
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091e0b50>
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/6.jpg saved to cache
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1610>
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/5.jpg saved to cache
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836a910>
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/3.jpg saved to cache
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0950>
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/7.jpg saved to cache
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b5c90>
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/8.jpg saved to cache
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009420050>
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/9.jpg saved to cache
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836a290>
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F12fa9e0393c34a0d814a1cb6985ed479%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/10.jpg saved to cache
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dcd27977-5860-50aa-b978-7bbb07fe7d81
2026-03-24 22:57:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcd27977-5860-50aa-b978-7bbb07fe7d81, skipping ID generation
2026-03-24 22:57:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd27977-5860-50aa-b978-7bbb07fe7d81 with scrape type 1
2026-03-24 22:57:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcd27977-5860-50aa-b978-7bbb07fe7d81 sending to next pipeline
2026-03-24 22:57:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dcd27977-5860-50aa-b978-7bbb07fe7d81, identifier: 1980521
2026-03-24 22:57:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dcd27977-5860-50aa-b978-7bbb07fe7d81 with identifier: 1980521
2026-03-24 22:57:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dcd27977-5860-50aa-b978-7bbb07fe7d81 with identifier: 1980521
2026-03-24 22:57:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dcd27977-5860-50aa-b978-7bbb07fe7d81 with identifier: 1980521 to the API
2026-03-24 22:57:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dcd27977-5860-50aa-b978-7bbb07fe7d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 156558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcd27977-5860-50aa-b978-7bbb07fe7d81/dcd27977-5860-50aa-b978-7bbb07fe7d81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/12fa9e0393c34a0d814a1cb6985ed479/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980521%27 HTTP/1.1" 200 None
2026-03-24 22:57:04 [ayvens.be] INFO: Saving data for 1980521: {'created_time': 1774393024.456513, 'last_price_update_time': 1774393024.456522, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980521') HTTP/1.1" 204 0
2026-03-24 22:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:57:06 [ayvens.be] INFO: Found listing with ID: 1980522
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980522%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [ayvens.be] INFO: Scrape type for 1980522: 1
2026-03-24 22:57:06 [ayvens.be] INFO: Extracting data for car ID: 1980522
2026-03-24 22:57:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f635627d-0256-51b7-b902-356769f4d897 with identifier: 1980522
2026-03-24 22:57:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f635627d-0256-51b7-b902-356769f4d897 with scrape type 1
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/1.jpg not downloaded yet
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/2.jpg not downloaded yet
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/3.jpg not downloaded yet
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/4.jpg not downloaded yet
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/5.jpg not downloaded yet
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/6.jpg not downloaded yet
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/7.jpg not downloaded yet
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/8.jpg not downloaded yet
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/9.jpg not downloaded yet
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/10.jpg not downloaded yet
2026-03-24 22:57:06 [ayvens.be] INFO: Found listing with ID: 1980523
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980523%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [ayvens.be] INFO: Scrape type for 1980523: 1
2026-03-24 22:57:06 [ayvens.be] INFO: Extracting data for car ID: 1980523
2026-03-24 22:57:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1980523
2026-03-24 22:57:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989f5ad8-eedf-5233-b3f7-d3719562d97e with scrape type 1
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/1.jpg not downloaded yet
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/2.jpg not downloaded yet
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/3.jpg not downloaded yet
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/4.jpg not downloaded yet
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bfd55d0>
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/1.jpg saved to cache
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009193210>
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/2.jpg saved to cache
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/5.jpg not downloaded yet
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/6.jpg not downloaded yet
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097075d0>
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/7.jpg saved to cache
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cda0d0>
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/6.jpg saved to cache
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/7.jpg not downloaded yet
2026-03-24 22:57:06 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 6 pages/min), scraped 511 items (at 37 items/min)
2026-03-24 22:57:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/8.jpg not downloaded yet
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009839910>
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/8.jpg saved to cache
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830b650>
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/3.jpg saved to cache
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b6090>
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/4.jpg saved to cache
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913f390>
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/10.jpg saved to cache
2026-03-24 22:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009459cd0>
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/9.jpg saved to cache
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/9.jpg not downloaded yet
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/10.jpg not downloaded yet
2026-03-24 22:57:07 [ayvens.be] INFO: Found listing with ID: 1980524
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980524%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [ayvens.be] INFO: Scrape type for 1980524: 1
2026-03-24 22:57:07 [ayvens.be] INFO: Extracting data for car ID: 1980524
2026-03-24 22:57:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with identifier: 1980524
2026-03-24 22:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with scrape type 1
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/1.jpg not downloaded yet
2026-03-24 22:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830b550>
2026-03-24 22:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fc79759a6fc4b43db9277fe9617f05212%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/5.jpg saved to cache
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f635627d-0256-51b7-b902-356769f4d897
2026-03-24 22:57:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f635627d-0256-51b7-b902-356769f4d897, skipping ID generation
2026-03-24 22:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f635627d-0256-51b7-b902-356769f4d897 with scrape type 1
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f635627d-0256-51b7-b902-356769f4d897 sending to next pipeline
2026-03-24 22:57:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f635627d-0256-51b7-b902-356769f4d897, identifier: 1980522
2026-03-24 22:57:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f635627d-0256-51b7-b902-356769f4d897 with identifier: 1980522
2026-03-24 22:57:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f635627d-0256-51b7-b902-356769f4d897 with identifier: 1980522
2026-03-24 22:57:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f635627d-0256-51b7-b902-356769f4d897 with identifier: 1980522 to the API
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f635627d-0256-51b7-b902-356769f4d897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 103163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f635627d-0256-51b7-b902-356769f4d897/f635627d-0256-51b7-b902-356769f4d897_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/c79759a6fc4b43db9277fe9617f05212/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980522%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [ayvens.be] INFO: Saving data for 1980522: {'created_time': 1774393027.711123, 'last_price_update_time': 1774393027.711133, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980522') HTTP/1.1" 204 0
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/2.jpg not downloaded yet
2026-03-24 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/3.jpg not downloaded yet
2026-03-24 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/4.jpg not downloaded yet
2026-03-24 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/5.jpg not downloaded yet
2026-03-24 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/6.jpg not downloaded yet
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/7.jpg not downloaded yet
2026-03-24 22:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/8.jpg not downloaded yet
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/9.jpg not downloaded yet
2026-03-24 22:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009421190>
2026-03-24 22:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/2.jpg saved to cache
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009133150>
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/3.jpg saved to cache
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e2190>
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/1.jpg saved to cache
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/10.jpg not downloaded yet
2026-03-24 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008380590>
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/5.jpg saved to cache
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:08 [ayvens.be] INFO: Found listing with ID: 1980525
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980525%27 HTTP/1.1" 200 None
2026-03-24 22:57:08 [ayvens.be] INFO: Scrape type for 1980525: 1
2026-03-24 22:57:08 [ayvens.be] INFO: Extracting data for car ID: 1980525
2026-03-24 22:57:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1980525
2026-03-24 22:57:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c545d7af-3d4a-532c-b476-168ddfe5e144 with scrape type 1
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/1.jpg not downloaded yet
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009790790>
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/4.jpg saved to cache
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fa2d0>
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/6.jpg saved to cache
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009133590>
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/7.jpg saved to cache
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916f8d0>
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/8.jpg saved to cache
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/2.jpg not downloaded yet
2026-03-24 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/3.jpg not downloaded yet
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335090>
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/9.jpg saved to cache
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/4.jpg not downloaded yet
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336450>
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/2.jpg saved to cache
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/5.jpg not downloaded yet
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/6.jpg not downloaded yet
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009110290>
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Fab27a4c9712d4cd09fd858b1b945230e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/10.jpg saved to cache
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 989f5ad8-eedf-5233-b3f7-d3719562d97e
2026-03-24 22:57:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 989f5ad8-eedf-5233-b3f7-d3719562d97e, skipping ID generation
2026-03-24 22:57:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989f5ad8-eedf-5233-b3f7-d3719562d97e with scrape type 1
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 989f5ad8-eedf-5233-b3f7-d3719562d97e sending to next pipeline
2026-03-24 22:57:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 989f5ad8-eedf-5233-b3f7-d3719562d97e, identifier: 1980523
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aaed0>
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/4.jpg saved to cache
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009703f90>
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/1.jpg saved to cache
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914f6d0>
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/3.jpg saved to cache
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1980523
2026-03-24 22:57:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1980523
2026-03-24 22:57:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 989f5ad8-eedf-5233-b3f7-d3719562d97e with identifier: 1980523 to the API
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '989f5ad8-eedf-5233-b3f7-d3719562d97e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 156232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_989f5ad8-eedf-5233-b3f7-d3719562d97e/989f5ad8-eedf-5233-b3f7-d3719562d97e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/ab27a4c9712d4cd09fd858b1b945230e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980523%27 HTTP/1.1" 200 None
2026-03-24 22:57:09 [ayvens.be] INFO: Saving data for 1980523: {'created_time': 1774393029.844221, 'last_price_update_time': 1774393029.844231, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980523') HTTP/1.1" 204 0
2026-03-24 22:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/7.jpg not downloaded yet
2026-03-24 22:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/8.jpg not downloaded yet
2026-03-24 22:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d71d0>
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/8.jpg saved to cache
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/9.jpg not downloaded yet
2026-03-24 22:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/10.jpg not downloaded yet
2026-03-24 22:57:09 [ayvens.be] INFO: Found listing with ID: 1980526
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980526%27 HTTP/1.1" 200 None
2026-03-24 22:57:10 [ayvens.be] INFO: Scrape type for 1980526: 1
2026-03-24 22:57:10 [ayvens.be] INFO: Extracting data for car ID: 1980526
2026-03-24 22:57:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1980526
2026-03-24 22:57:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed9de6f2-1704-5a9b-8651-e58841921921 with scrape type 1
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/1.jpg not downloaded yet
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bd2d0>
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/6.jpg saved to cache
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/2.jpg not downloaded yet
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938cb10>
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/7.jpg saved to cache
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369190>
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/5.jpg saved to cache
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/3.jpg not downloaded yet
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309e90>
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/10.jpg saved to cache
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b48d0>
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F43db19c076ef4094b1ab0ac342919ac9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/9.jpg saved to cache
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e
2026-03-24 22:57:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e, skipping ID generation
2026-03-24 22:57:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with scrape type 1
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09bb2fdb-822d-5f2b-9f33-6cf05107e48e sending to next pipeline
2026-03-24 22:57:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e, identifier: 1980524
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff017691910>
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/2.jpg saved to cache
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009629cd0>
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/1.jpg saved to cache
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/4.jpg not downloaded yet
2026-03-24 22:57:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with identifier: 1980524
2026-03-24 22:57:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with identifier: 1980524
2026-03-24 22:57:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09bb2fdb-822d-5f2b-9f33-6cf05107e48e with identifier: 1980524 to the API
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '09bb2fdb-822d-5f2b-9f33-6cf05107e48e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 64294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09bb2fdb-822d-5f2b-9f33-6cf05107e48e/09bb2fdb-822d-5f2b-9f33-6cf05107e48e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/43db19c076ef4094b1ab0ac342919ac9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2020}
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980524%27 HTTP/1.1" 200 None
2026-03-24 22:57:11 [ayvens.be] INFO: Saving data for 1980524: {'created_time': 1774393031.262607, 'last_price_update_time': 1774393031.262625, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980524') HTTP/1.1" 204 0
2026-03-24 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/5.jpg not downloaded yet
2026-03-24 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/6.jpg not downloaded yet
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916ef90>
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/3.jpg saved to cache
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/7.jpg not downloaded yet
2026-03-24 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/8.jpg not downloaded yet
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978a490>
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/4.jpg saved to cache
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962a4d0>
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/5.jpg saved to cache
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3610>
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/6.jpg saved to cache
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/9.jpg not downloaded yet
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/10.jpg not downloaded yet
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473110>
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/7.jpg saved to cache
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335f90>
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/9.jpg saved to cache
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097aa890>
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/8.jpg saved to cache
2026-03-24 22:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772610>
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F17ba3f181d8849e39bc8318a0f5f9789%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/10.jpg saved to cache
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c545d7af-3d4a-532c-b476-168ddfe5e144
2026-03-24 22:57:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c545d7af-3d4a-532c-b476-168ddfe5e144, skipping ID generation
2026-03-24 22:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c545d7af-3d4a-532c-b476-168ddfe5e144 with scrape type 1
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c545d7af-3d4a-532c-b476-168ddfe5e144 sending to next pipeline
2026-03-24 22:57:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c545d7af-3d4a-532c-b476-168ddfe5e144, identifier: 1980525
2026-03-24 22:57:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1980525
2026-03-24 22:57:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1980525
2026-03-24 22:57:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c545d7af-3d4a-532c-b476-168ddfe5e144 with identifier: 1980525 to the API
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c545d7af-3d4a-532c-b476-168ddfe5e144',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 149690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c545d7af-3d4a-532c-b476-168ddfe5e144/c545d7af-3d4a-532c-b476-168ddfe5e144_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/17ba3f181d8849e39bc8318a0f5f9789/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 STYLE',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 STYLE',
 'vin': None,
 'year': 2020}
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980525%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [ayvens.be] INFO: Saving data for 1980525: {'created_time': 1774393032.402684, 'last_price_update_time': 1774393032.402695, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980525') HTTP/1.1" 204 0
2026-03-24 22:57:12 [ayvens.be] INFO: Found listing with ID: 1980527
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980527%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [ayvens.be] INFO: Scrape type for 1980527: 1
2026-03-24 22:57:12 [ayvens.be] INFO: Extracting data for car ID: 1980527
2026-03-24 22:57:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea4b1268-0e13-587a-9857-70ac9f7fa363 with identifier: 1980527
2026-03-24 22:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4b1268-0e13-587a-9857-70ac9f7fa363 with scrape type 1
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/1.jpg not downloaded yet
2026-03-24 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/2.jpg not downloaded yet
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/3.jpg not downloaded yet
2026-03-24 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/4.jpg not downloaded yet
2026-03-24 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/5.jpg not downloaded yet
2026-03-24 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/6.jpg not downloaded yet
2026-03-24 22:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/7.jpg not downloaded yet
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/8.jpg not downloaded yet
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442a50>
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/1.jpg saved to cache
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/9.jpg not downloaded yet
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/10.jpg not downloaded yet
2026-03-24 22:57:12 [ayvens.be] INFO: Found listing with ID: 1980528
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980528%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [ayvens.be] INFO: Scrape type for 1980528: 1
2026-03-24 22:57:12 [ayvens.be] INFO: Extracting data for car ID: 1980528
2026-03-24 22:57:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 531f8a05-552a-579e-a2ec-7042eca47608 with identifier: 1980528
2026-03-24 22:57:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 531f8a05-552a-579e-a2ec-7042eca47608 with scrape type 1
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/1.jpg not downloaded yet
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009191610>
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/3.jpg saved to cache
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009186450>
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/5.jpg saved to cache
2026-03-24 22:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967eb50>
2026-03-24 22:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/2.jpg saved to cache
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b83d0>
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/4.jpg saved to cache
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083ba2d0>
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/6.jpg saved to cache
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091c9e50>
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/7.jpg saved to cache
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008315150>
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/8.jpg saved to cache
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/2.jpg not downloaded yet
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/3.jpg not downloaded yet
2026-03-24 22:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/4.jpg not downloaded yet
2026-03-24 22:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/5.jpg not downloaded yet
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/6.jpg not downloaded yet
2026-03-24 22:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/7.jpg not downloaded yet
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009008b90>
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/9.jpg saved to cache
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/8.jpg not downloaded yet
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/9.jpg not downloaded yet
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/10.jpg not downloaded yet
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959c150>
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/3.jpg saved to cache
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a27d0>
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Ff874bbabc90445609723c5d19d1cde70%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/10.jpg saved to cache
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed9de6f2-1704-5a9b-8651-e58841921921
2026-03-24 22:57:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed9de6f2-1704-5a9b-8651-e58841921921, skipping ID generation
2026-03-24 22:57:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed9de6f2-1704-5a9b-8651-e58841921921 with scrape type 1
2026-03-24 22:57:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed9de6f2-1704-5a9b-8651-e58841921921 sending to next pipeline
2026-03-24 22:57:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ed9de6f2-1704-5a9b-8651-e58841921921, identifier: 1980526
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb1fd0>
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/1.jpg saved to cache
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009611d90>
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/2.jpg saved to cache
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1980526
2026-03-24 22:57:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1980526
2026-03-24 22:57:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ed9de6f2-1704-5a9b-8651-e58841921921 with identifier: 1980526 to the API
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ed9de6f2-1704-5a9b-8651-e58841921921',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 169869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed9de6f2-1704-5a9b-8651-e58841921921/ed9de6f2-1704-5a9b-8651-e58841921921_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/f874bbabc90445609723c5d19d1cde70/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.6 CRTDI 88KW DSG7 AMBITION',
 'transmission': 'automatic',
 'trim': '1.6 CRTDI 88KW DSG7 AMBITION',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980526%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [ayvens.be] INFO: Saving data for 1980526: {'created_time': 1774393034.481175, 'last_price_update_time': 1774393034.481184, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980526') HTTP/1.1" 204 0
2026-03-24 22:57:14 [ayvens.be] INFO: Found listing with ID: 1980529
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980529%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [ayvens.be] INFO: Scrape type for 1980529: 1
2026-03-24 22:57:14 [ayvens.be] INFO: Extracting data for car ID: 1980529
2026-03-24 22:57:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e6a832f-1230-5bff-acc6-21ed6777f720 with identifier: 1980529
2026-03-24 22:57:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e6a832f-1230-5bff-acc6-21ed6777f720 with scrape type 1
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/1.jpg not downloaded yet
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/2.jpg not downloaded yet
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/3.jpg not downloaded yet
2026-03-24 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/4.jpg not downloaded yet
2026-03-24 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/5.jpg not downloaded yet
2026-03-24 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/6.jpg not downloaded yet
2026-03-24 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/7.jpg not downloaded yet
2026-03-24 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/8.jpg not downloaded yet
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/9.jpg not downloaded yet
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3550>
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/8.jpg saved to cache
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/10.jpg not downloaded yet
2026-03-24 22:57:14 [ayvens.be] INFO: Found listing with ID: 1980530
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980530%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [ayvens.be] INFO: Scrape type for 1980530: 1
2026-03-24 22:57:14 [ayvens.be] INFO: Extracting data for car ID: 1980530
2026-03-24 22:57:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee3085e8-c9ce-5699-aee1-9123a41beb5e with identifier: 1980530
2026-03-24 22:57:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3085e8-c9ce-5699-aee1-9123a41beb5e with scrape type 1
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/1.jpg not downloaded yet
2026-03-24 22:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/2.jpg not downloaded yet
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008368c10>
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/7.jpg saved to cache
2026-03-24 22:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008380550>
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/9.jpg saved to cache
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009667a50>
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/4.jpg saved to cache
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009491f10>
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/5.jpg saved to cache
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d8d0>
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/1.jpg saved to cache
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945b890>
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/6.jpg saved to cache
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666b10>
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F161526f7a2a64a3a8e1336efc7be06a9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/10.jpg saved to cache
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea4b1268-0e13-587a-9857-70ac9f7fa363
2026-03-24 22:57:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea4b1268-0e13-587a-9857-70ac9f7fa363, skipping ID generation
2026-03-24 22:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4b1268-0e13-587a-9857-70ac9f7fa363 with scrape type 1
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea4b1268-0e13-587a-9857-70ac9f7fa363 sending to next pipeline
2026-03-24 22:57:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ea4b1268-0e13-587a-9857-70ac9f7fa363, identifier: 1980527
2026-03-24 22:57:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ea4b1268-0e13-587a-9857-70ac9f7fa363 with identifier: 1980527
2026-03-24 22:57:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ea4b1268-0e13-587a-9857-70ac9f7fa363 with identifier: 1980527
2026-03-24 22:57:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ea4b1268-0e13-587a-9857-70ac9f7fa363 with identifier: 1980527 to the API
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ea4b1268-0e13-587a-9857-70ac9f7fa363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 80877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 923858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea4b1268-0e13-587a-9857-70ac9f7fa363/ea4b1268-0e13-587a-9857-70ac9f7fa363_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 854918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/161526f7a2a64a3a8e1336efc7be06a9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM PRO',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM PRO',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980527%27 HTTP/1.1" 200 None
2026-03-24 22:57:15 [ayvens.be] INFO: Saving data for 1980527: {'created_time': 1774393035.880129, 'last_price_update_time': 1774393035.880138, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980527') HTTP/1.1" 204 0
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/3.jpg not downloaded yet
2026-03-24 22:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/4.jpg not downloaded yet
2026-03-24 22:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b150>
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/2.jpg saved to cache
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/5.jpg not downloaded yet
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/6.jpg not downloaded yet
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916c110>
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/4.jpg saved to cache
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018b10>
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/3.jpg saved to cache
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/7.jpg not downloaded yet
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914d490>
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/5.jpg saved to cache
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/8.jpg not downloaded yet
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009466890>
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/6.jpg saved to cache
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018110>
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/2.jpg saved to cache
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/9.jpg not downloaded yet
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/10.jpg not downloaded yet
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009443290>
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/7.jpg saved to cache
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [ayvens.be] INFO: Found listing with ID: 1980531
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980531%27 HTTP/1.1" 200 None
2026-03-24 22:57:16 [ayvens.be] INFO: Scrape type for 1980531: 1
2026-03-24 22:57:16 [ayvens.be] INFO: Extracting data for car ID: 1980531
2026-03-24 22:57:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30d9656e-2bff-5edd-a622-e761c0e64a36 with identifier: 1980531
2026-03-24 22:57:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30d9656e-2bff-5edd-a622-e761c0e64a36 with scrape type 1
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/1.jpg not downloaded yet
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/2.jpg not downloaded yet
2026-03-24 22:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009395f90>
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/8.jpg saved to cache
2026-03-24 22:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6c50>
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/9.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008344d50>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/3.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/3.jpg not downloaded yet
2026-03-24 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/4.jpg not downloaded yet
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/5.jpg not downloaded yet
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cd92d0>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/4.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4d50>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/2.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94b10>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/10.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009629990>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/9.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009422b90>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/1.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/6.jpg not downloaded yet
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/7.jpg not downloaded yet
2026-03-24 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae4d0>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/6.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae450>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/7.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/8.jpg not downloaded yet
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/9.jpg not downloaded yet
2026-03-24 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/10.jpg not downloaded yet
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d19d0>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/8.jpg saved to cache
2026-03-24 22:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872310>
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/5.jpg saved to cache
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008385990>
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/3.jpg saved to cache
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009640190>
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/5.jpg saved to cache
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:18 [ayvens.be] INFO: Found listing with ID: 1980532
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980532%27 HTTP/1.1" 200 None
2026-03-24 22:57:18 [ayvens.be] INFO: Scrape type for 1980532: 1
2026-03-24 22:57:18 [ayvens.be] INFO: Extracting data for car ID: 1980532
2026-03-24 22:57:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with identifier: 1980532
2026-03-24 22:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with scrape type 1
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/1.jpg not downloaded yet
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/2.jpg not downloaded yet
2026-03-24 22:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910cd50>
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/4.jpg saved to cache
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009862e90>
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/6.jpg saved to cache
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/3.jpg not downloaded yet
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/4.jpg not downloaded yet
2026-03-24 22:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/5.jpg not downloaded yet
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911fad0>
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/8.jpg saved to cache
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967dc10>
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/7.jpg saved to cache
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946f210>
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/10.jpg saved to cache
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b6a90>
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Ffd848f00ad394e22a597b0ef86f61a75%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/1.jpg saved to cache
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e6a832f-1230-5bff-acc6-21ed6777f720
2026-03-24 22:57:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e6a832f-1230-5bff-acc6-21ed6777f720, skipping ID generation
2026-03-24 22:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e6a832f-1230-5bff-acc6-21ed6777f720 with scrape type 1
2026-03-24 22:57:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e6a832f-1230-5bff-acc6-21ed6777f720 sending to next pipeline
2026-03-24 22:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8e6a832f-1230-5bff-acc6-21ed6777f720, identifier: 1980529
2026-03-24 22:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8e6a832f-1230-5bff-acc6-21ed6777f720 with identifier: 1980529
2026-03-24 22:57:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8e6a832f-1230-5bff-acc6-21ed6777f720 with identifier: 1980529
2026-03-24 22:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8e6a832f-1230-5bff-acc6-21ed6777f720 with identifier: 1980529 to the API
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8e6a832f-1230-5bff-acc6-21ed6777f720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL - 2019',
 'odometer': 159854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e6a832f-1230-5bff-acc6-21ed6777f720/8e6a832f-1230-5bff-acc6-21ed6777f720_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/fd848f00ad394e22a597b0ef86f61a75/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-08',
 'seats_number': 7,
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL - 2019 2.0 TD4 4WD SE',
 'transmission': 'automatic',
 'trim': '2.0 TD4 4WD SE',
 'vin': None,
 'year': 2020}
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980529%27 HTTP/1.1" 200 None
2026-03-24 22:57:19 [ayvens.be] INFO: Saving data for 1980529: {'created_time': 1774393039.479395, 'last_price_update_time': 1774393039.479404, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980529') HTTP/1.1" 204 0
2026-03-24 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/6.jpg not downloaded yet
2026-03-24 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/7.jpg not downloaded yet
2026-03-24 22:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009613350>
2026-03-24 22:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F79c767bb39544021904df2f5920f481f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/9.jpg saved to cache
2026-03-24 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee3085e8-c9ce-5699-aee1-9123a41beb5e
2026-03-24 22:57:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee3085e8-c9ce-5699-aee1-9123a41beb5e, skipping ID generation
2026-03-24 22:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3085e8-c9ce-5699-aee1-9123a41beb5e with scrape type 1
2026-03-24 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee3085e8-c9ce-5699-aee1-9123a41beb5e sending to next pipeline
2026-03-24 22:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee3085e8-c9ce-5699-aee1-9123a41beb5e, identifier: 1980530
2026-03-24 22:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/8.jpg not downloaded yet
2026-03-24 22:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee3085e8-c9ce-5699-aee1-9123a41beb5e with identifier: 1980530
2026-03-24 22:57:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee3085e8-c9ce-5699-aee1-9123a41beb5e with identifier: 1980530
2026-03-24 22:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee3085e8-c9ce-5699-aee1-9123a41beb5e with identifier: 1980530 to the API
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ee3085e8-c9ce-5699-aee1-9123a41beb5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 175784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3085e8-c9ce-5699-aee1-9123a41beb5e/ee3085e8-c9ce-5699-aee1-9123a41beb5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/79c767bb39544021904df2f5920f481f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2020}
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980530%27 HTTP/1.1" 200 None
2026-03-24 22:57:20 [ayvens.be] INFO: Saving data for 1980530: {'created_time': 1774393040.039051, 'last_price_update_time': 1774393040.039062, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980530') HTTP/1.1" 204 0
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/9.jpg not downloaded yet
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009111f10>
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/1.jpg saved to cache
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008326650>
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/3.jpg saved to cache
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473d90>
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fc039d23c78f743cb9a052efa30d71bc0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/10.jpg saved to cache
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 531f8a05-552a-579e-a2ec-7042eca47608
2026-03-24 22:57:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 531f8a05-552a-579e-a2ec-7042eca47608, skipping ID generation
2026-03-24 22:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 531f8a05-552a-579e-a2ec-7042eca47608 with scrape type 1
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 531f8a05-552a-579e-a2ec-7042eca47608 sending to next pipeline
2026-03-24 22:57:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 531f8a05-552a-579e-a2ec-7042eca47608, identifier: 1980528
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911fad0>
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/2.jpg saved to cache
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 531f8a05-552a-579e-a2ec-7042eca47608 with identifier: 1980528
2026-03-24 22:57:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 531f8a05-552a-579e-a2ec-7042eca47608 with identifier: 1980528
2026-03-24 22:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 531f8a05-552a-579e-a2ec-7042eca47608 with identifier: 1980528 to the API
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'MINERALWEISS',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '531f8a05-552a-579e-a2ec-7042eca47608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 157144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 897532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531f8a05-552a-579e-a2ec-7042eca47608/531f8a05-552a-579e-a2ec-7042eca47608_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/c039d23c78f743cb9a052efa30d71bc0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980528%27 HTTP/1.1" 200 None
2026-03-24 22:57:20 [ayvens.be] INFO: Saving data for 1980528: {'created_time': 1774393040.720606, 'last_price_update_time': 1774393040.720615, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980528') HTTP/1.1" 204 0
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/10.jpg not downloaded yet
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfed50>
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/6.jpg saved to cache
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:20 [ayvens.be] INFO: Found listing with ID: 1980533
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980533%27 HTTP/1.1" 200 None
2026-03-24 22:57:20 [ayvens.be] INFO: Scrape type for 1980533: 1
2026-03-24 22:57:20 [ayvens.be] INFO: Extracting data for car ID: 1980533
2026-03-24 22:57:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1a3554-0055-53af-a270-fe16424e8590 with identifier: 1980533
2026-03-24 22:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1a3554-0055-53af-a270-fe16424e8590 with scrape type 1
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/1.jpg not downloaded yet
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917ff10>
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/4.jpg saved to cache
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/2.jpg not downloaded yet
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/3.jpg not downloaded yet
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ace90>
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/9.jpg saved to cache
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/4.jpg not downloaded yet
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/5.jpg not downloaded yet
2026-03-24 22:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/6.jpg not downloaded yet
2026-03-24 22:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/7.jpg not downloaded yet
2026-03-24 22:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/8.jpg not downloaded yet
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/9.jpg not downloaded yet
2026-03-24 22:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009640b10>
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/2.jpg saved to cache
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfda10>
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/5.jpg saved to cache
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/10.jpg not downloaded yet
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394090>
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/7.jpg saved to cache
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:21 [ayvens.be] INFO: Found listing with ID: 1980534
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980534%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [ayvens.be] INFO: Scrape type for 1980534: 1
2026-03-24 22:57:21 [ayvens.be] INFO: Extracting data for car ID: 1980534
2026-03-24 22:57:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3c01302-3a2c-5f20-b7f7-b55664bd78ee with identifier: 1980534
2026-03-24 22:57:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee with scrape type 1
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/1.jpg not downloaded yet
2026-03-24 22:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/2.jpg not downloaded yet
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187bd0>
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/8.jpg saved to cache
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910cc50>
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/3.jpg saved to cache
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/3.jpg not downloaded yet
2026-03-24 22:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/4.jpg not downloaded yet
2026-03-24 22:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946de90>
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F14db9178293a4d3aa13c330810f8e6fb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/10.jpg saved to cache
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30d9656e-2bff-5edd-a622-e761c0e64a36
2026-03-24 22:57:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30d9656e-2bff-5edd-a622-e761c0e64a36, skipping ID generation
2026-03-24 22:57:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30d9656e-2bff-5edd-a622-e761c0e64a36 with scrape type 1
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30d9656e-2bff-5edd-a622-e761c0e64a36 sending to next pipeline
2026-03-24 22:57:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30d9656e-2bff-5edd-a622-e761c0e64a36, identifier: 1980531
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/5.jpg not downloaded yet
2026-03-24 22:57:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30d9656e-2bff-5edd-a622-e761c0e64a36 with identifier: 1980531
2026-03-24 22:57:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30d9656e-2bff-5edd-a622-e761c0e64a36 with identifier: 1980531
2026-03-24 22:57:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30d9656e-2bff-5edd-a622-e761c0e64a36 with identifier: 1980531 to the API
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '30d9656e-2bff-5edd-a622-e761c0e64a36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2-serie',
 'odometer': 84286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d9656e-2bff-5edd-a622-e761c0e64a36/30d9656e-2bff-5edd-a622-e761c0e64a36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/14db9178293a4d3aa13c330810f8e6fb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2-serie 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980531%27 HTTP/1.1" 200 None
2026-03-24 22:57:22 [ayvens.be] INFO: Saving data for 1980531: {'created_time': 1774393042.227793, 'last_price_update_time': 1774393042.227803, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980531') HTTP/1.1" 204 0
2026-03-24 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/6.jpg not downloaded yet
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008381b10>
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/7.jpg saved to cache
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009397f50>
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/6.jpg saved to cache
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/7.jpg not downloaded yet
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/8.jpg not downloaded yet
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345e50>
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/8.jpg saved to cache
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1a8a50>
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/4.jpg saved to cache
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761010>
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/1.jpg saved to cache
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/9.jpg not downloaded yet
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/10.jpg not downloaded yet
2026-03-24 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:22 [ayvens.be] INFO: Found listing with ID: 1980535
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980535%27 HTTP/1.1" 200 None
2026-03-24 22:57:22 [ayvens.be] INFO: Scrape type for 1980535: 1
2026-03-24 22:57:22 [ayvens.be] INFO: Extracting data for car ID: 1980535
2026-03-24 22:57:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 793c0c01-3b2f-51f7-abf8-56f206854475 with identifier: 1980535
2026-03-24 22:57:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 793c0c01-3b2f-51f7-abf8-56f206854475 with scrape type 1
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/1.jpg not downloaded yet
2026-03-24 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/2.jpg not downloaded yet
2026-03-24 22:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/3.jpg not downloaded yet
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/4.jpg not downloaded yet
2026-03-24 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/5.jpg not downloaded yet
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/6.jpg not downloaded yet
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b2c8210>
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/2.jpg saved to cache
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c4750>
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/1.jpg saved to cache
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0610>
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/5.jpg saved to cache
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2050>
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/5.jpg saved to cache
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c4110>
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/10.jpg saved to cache
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008373c10>
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/6.jpg saved to cache
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/7.jpg not downloaded yet
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911a410>
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/4.jpg saved to cache
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009018c50>
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb07b83f16f464bb587e7c90b9729af17%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/9.jpg saved to cache
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2
2026-03-24 22:57:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2, skipping ID generation
2026-03-24 22:57:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with scrape type 1
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 sending to next pipeline
2026-03-24 22:57:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2, identifier: 1980532
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/8.jpg not downloaded yet
2026-03-24 22:57:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with identifier: 1980532
2026-03-24 22:57:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with identifier: 1980532
2026-03-24 22:57:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 37c6d6d4-46ac-5dce-91da-cd77a59a61e2 with identifier: 1980532 to the API
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '37c6d6d4-46ac-5dce-91da-cd77a59a61e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI DIESEL - 2020',
 'odometer': 130237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 892658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 879022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37c6d6d4-46ac-5dce-91da-cd77a59a61e2/37c6d6d4-46ac-5dce-91da-cd77a59a61e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b07b83f16f464bb587e7c90b9729af17/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI DIESEL - 2020 2.0 CR TDi EVO Style DSG',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi EVO Style DSG',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980532%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [ayvens.be] INFO: Saving data for 1980532: {'created_time': 1774393044.288753, 'last_price_update_time': 1774393044.288767, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980532') HTTP/1.1" 204 0
2026-03-24 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/9.jpg not downloaded yet
2026-03-24 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/10.jpg not downloaded yet
2026-03-24 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:24 [ayvens.be] INFO: Found listing with ID: 1980536
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980536%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [ayvens.be] INFO: Scrape type for 1980536: 1
2026-03-24 22:57:24 [ayvens.be] INFO: Extracting data for car ID: 1980536
2026-03-24 22:57:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0d7843d-493e-5efd-a98b-3ef4d71763c8 with identifier: 1980536
2026-03-24 22:57:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0d7843d-493e-5efd-a98b-3ef4d71763c8 with scrape type 1
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/1.jpg not downloaded yet
2026-03-24 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/2.jpg not downloaded yet
2026-03-24 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/3.jpg not downloaded yet
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/4.jpg not downloaded yet
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b5cd0>
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/3.jpg saved to cache
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/5.jpg not downloaded yet
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009772910>
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/5.jpg saved to cache
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/6.jpg not downloaded yet
2026-03-24 22:57:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/7.jpg not downloaded yet
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d00110>
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/10.jpg saved to cache
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835bed0>
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/3.jpg saved to cache
2026-03-24 22:57:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834d790>
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/8.jpg saved to cache
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d2290>
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/2.jpg saved to cache
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083152d0>
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/4.jpg saved to cache
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1750>
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/1.jpg saved to cache
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/8.jpg not downloaded yet
2026-03-24 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/9.jpg not downloaded yet
2026-03-24 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009667810>
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/1.jpg saved to cache
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/10.jpg not downloaded yet
2026-03-24 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:25 [ayvens.be] INFO: Found listing with ID: 1980537
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980537%27 HTTP/1.1" 200 None
2026-03-24 22:57:25 [ayvens.be] INFO: Scrape type for 1980537: 1
2026-03-24 22:57:25 [ayvens.be] INFO: Extracting data for car ID: 1980537
2026-03-24 22:57:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with identifier: 1980537
2026-03-24 22:57:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with scrape type 1
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/1.jpg not downloaded yet
2026-03-24 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/2.jpg not downloaded yet
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008384310>
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/3.jpg saved to cache
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00989b3d0>
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/2.jpg saved to cache
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962a490>
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/10.jpg saved to cache
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c07d0>
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/9.jpg saved to cache
2026-03-24 22:57:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096295d0>
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/7.jpg saved to cache
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/3.jpg not downloaded yet
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d6050>
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/7.jpg saved to cache
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/4.jpg not downloaded yet
2026-03-24 22:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009192cd0>
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/8.jpg saved to cache
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f1fd0>
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/8.jpg saved to cache
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091124d0>
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/10.jpg saved to cache
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967e8d0>
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/6.jpg saved to cache
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009009210>
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/9.jpg saved to cache
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/5.jpg not downloaded yet
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/6.jpg not downloaded yet
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e390>
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/4.jpg saved to cache
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983aad0>
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F42fe97beb36d41938e9201ca3bccf8e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/5.jpg saved to cache
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 793c0c01-3b2f-51f7-abf8-56f206854475
2026-03-24 22:57:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 793c0c01-3b2f-51f7-abf8-56f206854475, skipping ID generation
2026-03-24 22:57:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 793c0c01-3b2f-51f7-abf8-56f206854475 with scrape type 1
2026-03-24 22:57:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 793c0c01-3b2f-51f7-abf8-56f206854475 sending to next pipeline
2026-03-24 22:57:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 793c0c01-3b2f-51f7-abf8-56f206854475, identifier: 1980535
2026-03-24 22:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 793c0c01-3b2f-51f7-abf8-56f206854475 with identifier: 1980535
2026-03-24 22:57:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 793c0c01-3b2f-51f7-abf8-56f206854475 with identifier: 1980535
2026-03-24 22:57:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 793c0c01-3b2f-51f7-abf8-56f206854475 with identifier: 1980535 to the API
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '793c0c01-3b2f-51f7-abf8-56f206854475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 102641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_793c0c01-3b2f-51f7-abf8-56f206854475/793c0c01-3b2f-51f7-abf8-56f206854475_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/42fe97beb36d41938e9201ca3bccf8e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW) BELGIAN CUSTOMERS ONLY',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW) BELGIAN CUSTOMERS ONLY',
 'vin': None,
 'year': 2020}
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980535%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [ayvens.be] INFO: Saving data for 1980535: {'created_time': 1774393047.255929, 'last_price_update_time': 1774393047.255978, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980535') HTTP/1.1" 204 0
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/7.jpg not downloaded yet
2026-03-24 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/8.jpg not downloaded yet
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aa2d0>
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/1.jpg saved to cache
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aa410>
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/5.jpg saved to cache
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/9.jpg not downloaded yet
2026-03-24 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/10.jpg not downloaded yet
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a28d0>
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/6.jpg saved to cache
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:27 [ayvens.be] INFO: Found listing with ID: 1980538
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980538%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [ayvens.be] INFO: Scrape type for 1980538: 1
2026-03-24 22:57:27 [ayvens.be] INFO: Extracting data for car ID: 1980538
2026-03-24 22:57:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af63105-081c-5512-913f-f3447d11d7c9 with identifier: 1980538
2026-03-24 22:57:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af63105-081c-5512-913f-f3447d11d7c9 with scrape type 1
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/1.jpg not downloaded yet
2026-03-24 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/2.jpg not downloaded yet
2026-03-24 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bfa10>
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/3.jpg saved to cache
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913cd50>
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/7.jpg saved to cache
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/3.jpg not downloaded yet
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/4.jpg not downloaded yet
2026-03-24 22:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/5.jpg not downloaded yet
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a3290>
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/4.jpg saved to cache
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834cf10>
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/2.jpg saved to cache
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962b550>
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/8.jpg saved to cache
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/6.jpg not downloaded yet
2026-03-24 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/7.jpg not downloaded yet
2026-03-24 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a8ed0>
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F31a275ff58db42848ef73f41f73d312b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/6.jpg saved to cache
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee
2026-03-24 22:57:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3c01302-3a2c-5f20-b7f7-b55664bd78ee, skipping ID generation
2026-03-24 22:57:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee with scrape type 1
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3c01302-3a2c-5f20-b7f7-b55664bd78ee sending to next pipeline
2026-03-24 22:57:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c3c01302-3a2c-5f20-b7f7-b55664bd78ee, identifier: 1980534
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28790>
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/9.jpg saved to cache
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/8.jpg not downloaded yet
2026-03-24 22:57:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c3c01302-3a2c-5f20-b7f7-b55664bd78ee with identifier: 1980534
2026-03-24 22:57:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c3c01302-3a2c-5f20-b7f7-b55664bd78ee with identifier: 1980534
2026-03-24 22:57:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c3c01302-3a2c-5f20-b7f7-b55664bd78ee with identifier: 1980534 to the API
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c3c01302-3a2c-5f20-b7f7-b55664bd78ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 128234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c01302-3a2c-5f20-b7f7-b55664bd78ee/c3c01302-3a2c-5f20-b7f7-b55664bd78ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/31a275ff58db42848ef73f41f73d312b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980534%27 HTTP/1.1" 200 None
2026-03-24 22:57:28 [ayvens.be] INFO: Saving data for 1980534: {'created_time': 1774393048.87468, 'last_price_update_time': 1774393048.874689, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980534') HTTP/1.1" 204 0
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/9.jpg not downloaded yet
2026-03-24 22:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/10.jpg not downloaded yet
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a14d0>
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/1.jpg saved to cache
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009470d50>
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fd132fc9cf547452bbd33cf86412b2949%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/10.jpg saved to cache
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0d7843d-493e-5efd-a98b-3ef4d71763c8
2026-03-24 22:57:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0d7843d-493e-5efd-a98b-3ef4d71763c8, skipping ID generation
2026-03-24 22:57:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0d7843d-493e-5efd-a98b-3ef4d71763c8 with scrape type 1
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0d7843d-493e-5efd-a98b-3ef4d71763c8 sending to next pipeline
2026-03-24 22:57:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e0d7843d-493e-5efd-a98b-3ef4d71763c8, identifier: 1980536
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009614d10>
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/2.jpg saved to cache
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911a010>
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/9.jpg saved to cache
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e0d7843d-493e-5efd-a98b-3ef4d71763c8 with identifier: 1980536
2026-03-24 22:57:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e0d7843d-493e-5efd-a98b-3ef4d71763c8 with identifier: 1980536
2026-03-24 22:57:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e0d7843d-493e-5efd-a98b-3ef4d71763c8 with identifier: 1980536 to the API
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'e0d7843d-493e-5efd-a98b-3ef4d71763c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 66890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0d7843d-493e-5efd-a98b-3ef4d71763c8/e0d7843d-493e-5efd-a98b-3ef4d71763c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/d132fc9cf547452bbd33cf86412b2949/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 EDITION ONE GREY AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 EDITION ONE GREY AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980536%27 HTTP/1.1" 200 None
2026-03-24 22:57:29 [ayvens.be] INFO: Saving data for 1980536: {'created_time': 1774393049.760543, 'last_price_update_time': 1774393049.760552, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980536') HTTP/1.1" 204 0
2026-03-24 22:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:29 [ayvens.be] INFO: Found listing with ID: 1980539
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980539%27 HTTP/1.1" 200 None
2026-03-24 22:57:29 [ayvens.be] INFO: Scrape type for 1980539: 1
2026-03-24 22:57:29 [ayvens.be] INFO: Extracting data for car ID: 1980539
2026-03-24 22:57:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040088e1-6085-591e-8249-b75a78ad9128 with identifier: 1980539
2026-03-24 22:57:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040088e1-6085-591e-8249-b75a78ad9128 with scrape type 1
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/1.jpg not downloaded yet
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/2.jpg not downloaded yet
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d1bd0>
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/3.jpg saved to cache
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0710>
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fbedbb79cc5d54676a1388a53722b2b1a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/7.jpg saved to cache
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d1a3554-0055-53af-a270-fe16424e8590
2026-03-24 22:57:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d1a3554-0055-53af-a270-fe16424e8590, skipping ID generation
2026-03-24 22:57:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1a3554-0055-53af-a270-fe16424e8590 with scrape type 1
2026-03-24 22:57:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d1a3554-0055-53af-a270-fe16424e8590 sending to next pipeline
2026-03-24 22:57:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6d1a3554-0055-53af-a270-fe16424e8590, identifier: 1980533
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b6450>
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/5.jpg saved to cache
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/3.jpg not downloaded yet
2026-03-24 22:57:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6d1a3554-0055-53af-a270-fe16424e8590 with identifier: 1980533
2026-03-24 22:57:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6d1a3554-0055-53af-a270-fe16424e8590 with identifier: 1980533
2026-03-24 22:57:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6d1a3554-0055-53af-a270-fe16424e8590 with identifier: 1980533 to the API
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6d1a3554-0055-53af-a270-fe16424e8590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 79780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1a3554-0055-53af-a270-fe16424e8590/6d1a3554-0055-53af-a270-fe16424e8590_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/bedbb79cc5d54676a1388a53722b2b1a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980533%27 HTTP/1.1" 200 None
2026-03-24 22:57:30 [ayvens.be] INFO: Saving data for 1980533: {'created_time': 1774393050.495448, 'last_price_update_time': 1774393050.495457, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980533') HTTP/1.1" 204 0
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/4.jpg not downloaded yet
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098bcf50>
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/6.jpg saved to cache
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/5.jpg not downloaded yet
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095beed0>
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/7.jpg saved to cache
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/6.jpg not downloaded yet
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b1d0>
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/8.jpg saved to cache
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/7.jpg not downloaded yet
2026-03-24 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/8.jpg not downloaded yet
2026-03-24 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/9.jpg not downloaded yet
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7090>
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/10.jpg saved to cache
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009789050>
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/9.jpg saved to cache
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967ccd0>
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F3ebd778cb5004dc9b49d9c26090328b7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/4.jpg saved to cache
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa
2026-03-24 22:57:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa, skipping ID generation
2026-03-24 22:57:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with scrape type 1
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa sending to next pipeline
2026-03-24 22:57:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa, identifier: 1980537
2026-03-24 22:57:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with identifier: 1980537
2026-03-24 22:57:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with identifier: 1980537
2026-03-24 22:57:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2c6c750c-311e-5bb4-92b0-52a55d2cc9fa with identifier: 1980537 to the API
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '2c6c750c-311e-5bb4-92b0-52a55d2cc9fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 154840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 874914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c6c750c-311e-5bb4-92b0-52a55d2cc9fa/2c6c750c-311e-5bb4-92b0-52a55d2cc9fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 898989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/3ebd778cb5004dc9b49d9c26090328b7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980537%27 HTTP/1.1" 200 None
2026-03-24 22:57:31 [ayvens.be] INFO: Saving data for 1980537: {'created_time': 1774393051.744915, 'last_price_update_time': 1774393051.744924, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980537') HTTP/1.1" 204 0
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/10.jpg not downloaded yet
2026-03-24 22:57:31 [ayvens.be] INFO: Found listing with ID: 1980540
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980540%27 HTTP/1.1" 200 None
2026-03-24 22:57:31 [ayvens.be] INFO: Scrape type for 1980540: 1
2026-03-24 22:57:31 [ayvens.be] INFO: Extracting data for car ID: 1980540
2026-03-24 22:57:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1980540
2026-03-24 22:57:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a584356-5629-50b3-a6ac-7d347cf34300 with scrape type 1
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/1.jpg not downloaded yet
2026-03-24 22:57:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c510>
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/1.jpg saved to cache
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970e3d0>
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/4.jpg saved to cache
2026-03-24 22:57:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008339d10>
2026-03-24 22:57:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/2.jpg saved to cache
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914d310>
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/5.jpg saved to cache
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/2.jpg not downloaded yet
2026-03-24 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/3.jpg not downloaded yet
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938cfd0>
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/3.jpg saved to cache
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394190>
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/6.jpg saved to cache
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/4.jpg not downloaded yet
2026-03-24 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/5.jpg not downloaded yet
2026-03-24 22:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913d8d0>
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/9.jpg saved to cache
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112dd0>
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/7.jpg saved to cache
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/6.jpg not downloaded yet
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/7.jpg not downloaded yet
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/8.jpg not downloaded yet
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc5b50>
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/10.jpg saved to cache
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009707e10>
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252F73ea8767d4e444b58207af27e5bb7b23%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/8.jpg saved to cache
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5af63105-081c-5512-913f-f3447d11d7c9
2026-03-24 22:57:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5af63105-081c-5512-913f-f3447d11d7c9, skipping ID generation
2026-03-24 22:57:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af63105-081c-5512-913f-f3447d11d7c9 with scrape type 1
2026-03-24 22:57:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5af63105-081c-5512-913f-f3447d11d7c9 sending to next pipeline
2026-03-24 22:57:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5af63105-081c-5512-913f-f3447d11d7c9, identifier: 1980538
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0690>
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/1.jpg saved to cache
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938f550>
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/2.jpg saved to cache
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5af63105-081c-5512-913f-f3447d11d7c9 with identifier: 1980538
2026-03-24 22:57:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5af63105-081c-5512-913f-f3447d11d7c9 with identifier: 1980538
2026-03-24 22:57:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5af63105-081c-5512-913f-f3447d11d7c9 with identifier: 1980538 to the API
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '5af63105-081c-5512-913f-f3447d11d7c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 80507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af63105-081c-5512-913f-f3447d11d7c9/5af63105-081c-5512-913f-f3447d11d7c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/73ea8767d4e444b58207af27e5bb7b23/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980538%27 HTTP/1.1" 200 None
2026-03-24 22:57:33 [ayvens.be] INFO: Saving data for 1980538: {'created_time': 1774393053.404987, 'last_price_update_time': 1774393053.404997, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980538') HTTP/1.1" 204 0
2026-03-24 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/9.jpg not downloaded yet
2026-03-24 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/10.jpg not downloaded yet
2026-03-24 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:33 [ayvens.be] INFO: Found listing with ID: 1980541
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980541%27 HTTP/1.1" 200 None
2026-03-24 22:57:33 [ayvens.be] INFO: Scrape type for 1980541: 1
2026-03-24 22:57:33 [ayvens.be] INFO: Extracting data for car ID: 1980541
2026-03-24 22:57:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1980541
2026-03-24 22:57:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac91607f-a69f-52f7-9c65-c869b70c8f00 with scrape type 1
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/1.jpg not downloaded yet
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/2.jpg not downloaded yet
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c3310>
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/4.jpg saved to cache
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/3.jpg not downloaded yet
2026-03-24 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369d10>
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/3.jpg saved to cache
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/4.jpg not downloaded yet
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/5.jpg not downloaded yet
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00bfbcd90>
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/6.jpg saved to cache
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938d1d0>
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/5.jpg saved to cache
2026-03-24 22:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009112390>
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/7.jpg saved to cache
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/6.jpg not downloaded yet
2026-03-24 22:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/7.jpg not downloaded yet
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916e650>
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/10.jpg saved to cache
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ce990>
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/8.jpg saved to cache
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009420a50>
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F91652612fba84c7f9ee279c7cedc30cf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/9.jpg saved to cache
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 040088e1-6085-591e-8249-b75a78ad9128
2026-03-24 22:57:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 040088e1-6085-591e-8249-b75a78ad9128, skipping ID generation
2026-03-24 22:57:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040088e1-6085-591e-8249-b75a78ad9128 with scrape type 1
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 040088e1-6085-591e-8249-b75a78ad9128 sending to next pipeline
2026-03-24 22:57:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 040088e1-6085-591e-8249-b75a78ad9128, identifier: 1980539
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/8.jpg not downloaded yet
2026-03-24 22:57:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 040088e1-6085-591e-8249-b75a78ad9128 with identifier: 1980539
2026-03-24 22:57:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 040088e1-6085-591e-8249-b75a78ad9128 with identifier: 1980539
2026-03-24 22:57:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 040088e1-6085-591e-8249-b75a78ad9128 with identifier: 1980539 to the API
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '040088e1-6085-591e-8249-b75a78ad9128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 48710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040088e1-6085-591e-8249-b75a78ad9128/040088e1-6085-591e-8249-b75a78ad9128_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/91652612fba84c7f9ee279c7cedc30cf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980539%27 HTTP/1.1" 200 None
2026-03-24 22:57:34 [ayvens.be] INFO: Saving data for 1980539: {'created_time': 1774393054.777455, 'last_price_update_time': 1774393054.777465, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980539') HTTP/1.1" 204 0
2026-03-24 22:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/9.jpg not downloaded yet
2026-03-24 22:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/10.jpg not downloaded yet
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bce50>
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/1.jpg saved to cache
2026-03-24 22:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914f690>
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/5.jpg saved to cache
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:35 [ayvens.be] INFO: Found listing with ID: 1980542
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980542%27 HTTP/1.1" 200 None
2026-03-24 22:57:35 [ayvens.be] INFO: Scrape type for 1980542: 1
2026-03-24 22:57:35 [ayvens.be] INFO: Extracting data for car ID: 1980542
2026-03-24 22:57:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1980542
2026-03-24 22:57:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with scrape type 1
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/1.jpg not downloaded yet
2026-03-24 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/2.jpg not downloaded yet
2026-03-24 22:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a29b90>
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/4.jpg saved to cache
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009773250>
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/2.jpg saved to cache
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8690>
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/3.jpg saved to cache
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309450>
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/6.jpg saved to cache
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/3.jpg not downloaded yet
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/4.jpg not downloaded yet
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/5.jpg not downloaded yet
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1ba350>
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/7.jpg saved to cache
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1f90>
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/8.jpg saved to cache
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872a50>
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/10.jpg saved to cache
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c0ed0>
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F7905caa8f21a40b289680de6786e5417%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/9.jpg saved to cache
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a584356-5629-50b3-a6ac-7d347cf34300
2026-03-24 22:57:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a584356-5629-50b3-a6ac-7d347cf34300, skipping ID generation
2026-03-24 22:57:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a584356-5629-50b3-a6ac-7d347cf34300 with scrape type 1
2026-03-24 22:57:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a584356-5629-50b3-a6ac-7d347cf34300 sending to next pipeline
2026-03-24 22:57:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a584356-5629-50b3-a6ac-7d347cf34300, identifier: 1980540
2026-03-24 22:57:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1980540
2026-03-24 22:57:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1980540
2026-03-24 22:57:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a584356-5629-50b3-a6ac-7d347cf34300 with identifier: 1980540 to the API
2026-03-24 22:57:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3a584356-5629-50b3-a6ac-7d347cf34300',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 94794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a584356-5629-50b3-a6ac-7d347cf34300/3a584356-5629-50b3-a6ac-7d347cf34300_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/7905caa8f21a40b289680de6786e5417/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980540%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [ayvens.be] INFO: Saving data for 1980540: {'created_time': 1774393056.192331, 'last_price_update_time': 1774393056.192341, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980540') HTTP/1.1" 204 0
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/6.jpg not downloaded yet
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/7.jpg not downloaded yet
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/8.jpg not downloaded yet
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/9.jpg not downloaded yet
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/10.jpg not downloaded yet
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [ayvens.be] INFO: Found listing with ID: 1980543
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980543%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [ayvens.be] INFO: Scrape type for 1980543: 1
2026-03-24 22:57:36 [ayvens.be] INFO: Extracting data for car ID: 1980543
2026-03-24 22:57:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1980543
2026-03-24 22:57:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340005c8-2f01-5331-9c8f-219207504f55 with scrape type 1
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/1.jpg not downloaded yet
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/2.jpg not downloaded yet
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00919a5d0>
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/1.jpg saved to cache
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097aa650>
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/3.jpg saved to cache
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0590>
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/2.jpg saved to cache
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d5250>
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/6.jpg saved to cache
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c3590>
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/5.jpg saved to cache
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c0a50>
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/4.jpg saved to cache
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/3.jpg not downloaded yet
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/4.jpg not downloaded yet
2026-03-24 22:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/5.jpg not downloaded yet
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a9050>
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/7.jpg saved to cache
2026-03-24 22:57:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7e10>
2026-03-24 22:57:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/8.jpg saved to cache
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/6.jpg not downloaded yet
2026-03-24 22:57:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/7.jpg not downloaded yet
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009129750>
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/10.jpg saved to cache
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6d10>
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F968ed49f57684be4a1ac1a13d339e0bf%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/9.jpg saved to cache
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac91607f-a69f-52f7-9c65-c869b70c8f00
2026-03-24 22:57:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac91607f-a69f-52f7-9c65-c869b70c8f00, skipping ID generation
2026-03-24 22:57:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac91607f-a69f-52f7-9c65-c869b70c8f00 with scrape type 1
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac91607f-a69f-52f7-9c65-c869b70c8f00 sending to next pipeline
2026-03-24 22:57:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac91607f-a69f-52f7-9c65-c869b70c8f00, identifier: 1980541
2026-03-24 22:57:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/8.jpg not downloaded yet
2026-03-24 22:57:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1980541
2026-03-24 22:57:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1980541
2026-03-24 22:57:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ac91607f-a69f-52f7-9c65-c869b70c8f00 with identifier: 1980541 to the API
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ac91607f-a69f-52f7-9c65-c869b70c8f00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 40666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac91607f-a69f-52f7-9c65-c869b70c8f00/ac91607f-a69f-52f7-9c65-c869b70c8f00_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/968ed49f57684be4a1ac1a13d339e0bf/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S GT',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S&S GT',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980541%27 HTTP/1.1" 200 None
2026-03-24 22:57:37 [ayvens.be] INFO: Saving data for 1980541: {'created_time': 1774393057.63832, 'last_price_update_time': 1774393057.63833, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980541') HTTP/1.1" 204 0
2026-03-24 22:57:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/9.jpg not downloaded yet
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/10.jpg not downloaded yet
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009665cd0>
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/1.jpg saved to cache
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008313750>
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/2.jpg saved to cache
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009941410>
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/6.jpg saved to cache
2026-03-24 22:57:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0b90>
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/5.jpg saved to cache
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [ayvens.be] INFO: Found listing with ID: 1980544
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980544%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [ayvens.be] INFO: Scrape type for 1980544: 1
2026-03-24 22:57:38 [ayvens.be] INFO: Extracting data for car ID: 1980544
2026-03-24 22:57:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1980544
2026-03-24 22:57:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with scrape type 1
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/1.jpg not downloaded yet
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/2.jpg not downloaded yet
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed1390>
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/3.jpg saved to cache
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666550>
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/4.jpg saved to cache
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/3.jpg not downloaded yet
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/4.jpg not downloaded yet
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/5.jpg not downloaded yet
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970d550>
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/7.jpg saved to cache
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912aa90>
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/3.jpg saved to cache
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00830b710>
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/9.jpg saved to cache
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/6.jpg not downloaded yet
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/7.jpg not downloaded yet
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0fd0>
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/8.jpg saved to cache
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/8.jpg not downloaded yet
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/9.jpg not downloaded yet
2026-03-24 22:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/10.jpg not downloaded yet
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c72d0>
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc39a6f12e0164f169bdb480e58e49604%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/10.jpg saved to cache
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89
2026-03-24 22:57:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89, skipping ID generation
2026-03-24 22:57:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with scrape type 1
2026-03-24 22:57:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 sending to next pipeline
2026-03-24 22:57:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89, identifier: 1980542
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009942190>
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/2.jpg saved to cache
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2a510>
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/1.jpg saved to cache
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962c350>
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/4.jpg saved to cache
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1980542
2026-03-24 22:57:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1980542
2026-03-24 22:57:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0238b4ff-f3fd-56fb-b2ff-97a7b2555e89 with identifier: 1980542 to the API
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0238b4ff-f3fd-56fb-b2ff-97a7b2555e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA SPORTS TOURER DIESEL',
 'odometer': 154481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0238b4ff-f3fd-56fb-b2ff-97a7b2555e89/0238b4ff-f3fd-56fb-b2ff-97a7b2555e89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c39a6f12e0164f169bdb480e58e49604/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA SPORTS TOURER DIESEL 1.5 Turbo D Business Edition',
 'transmission': 'automatic',
 'trim': '1.5 Turbo D Business Edition',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980542%27 HTTP/1.1" 200 None
2026-03-24 22:57:39 [ayvens.be] INFO: Saving data for 1980542: {'created_time': 1774393059.473285, 'last_price_update_time': 1774393059.473294, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980542') HTTP/1.1" 204 0
2026-03-24 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:39 [ayvens.be] INFO: Found listing with ID: 1980545
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980545%27 HTTP/1.1" 200 None
2026-03-24 22:57:39 [ayvens.be] INFO: Scrape type for 1980545: 1
2026-03-24 22:57:39 [ayvens.be] INFO: Extracting data for car ID: 1980545
2026-03-24 22:57:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1980545
2026-03-24 22:57:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe3a826-d1b0-5341-92c4-687efe5da057 with scrape type 1
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/1.jpg not downloaded yet
2026-03-24 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/2.jpg not downloaded yet
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009940c90>
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/5.jpg saved to cache
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c67d0>
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/6.jpg saved to cache
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/3.jpg not downloaded yet
2026-03-24 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/4.jpg not downloaded yet
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962e8d0>
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/7.jpg saved to cache
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c4d50>
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/8.jpg saved to cache
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/5.jpg not downloaded yet
2026-03-24 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/6.jpg not downloaded yet
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009707110>
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/10.jpg saved to cache
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009664d50>
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fe5df7b058e904c37aaebe06c078916f5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/9.jpg saved to cache
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 340005c8-2f01-5331-9c8f-219207504f55
2026-03-24 22:57:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 340005c8-2f01-5331-9c8f-219207504f55, skipping ID generation
2026-03-24 22:57:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340005c8-2f01-5331-9c8f-219207504f55 with scrape type 1
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 340005c8-2f01-5331-9c8f-219207504f55 sending to next pipeline
2026-03-24 22:57:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 340005c8-2f01-5331-9c8f-219207504f55, identifier: 1980543
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/7.jpg not downloaded yet
2026-03-24 22:57:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1980543
2026-03-24 22:57:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1980543
2026-03-24 22:57:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 340005c8-2f01-5331-9c8f-219207504f55 with identifier: 1980543 to the API
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '340005c8-2f01-5331-9c8f-219207504f55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 102888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_340005c8-2f01-5331-9c8f-219207504f55/340005c8-2f01-5331-9c8f-219207504f55_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/e5df7b058e904c37aaebe06c078916f5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980543%27 HTTP/1.1" 200 None
2026-03-24 22:57:40 [ayvens.be] INFO: Saving data for 1980543: {'created_time': 1774393060.620384, 'last_price_update_time': 1774393060.620394, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980543') HTTP/1.1" 204 0
2026-03-24 22:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/8.jpg not downloaded yet
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/9.jpg not downloaded yet
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638590>
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/2.jpg saved to cache
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145ed0>
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/1.jpg saved to cache
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788d10>
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/3.jpg saved to cache
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/10.jpg not downloaded yet
2026-03-24 22:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:40 [ayvens.be] INFO: Found listing with ID: 1980546
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980546%27 HTTP/1.1" 200 None
2026-03-24 22:57:40 [ayvens.be] INFO: Scrape type for 1980546: 1
2026-03-24 22:57:40 [ayvens.be] INFO: Extracting data for car ID: 1980546
2026-03-24 22:57:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b301a7c-9d8b-59da-96f3-520d9af662c0 with identifier: 1980546
2026-03-24 22:57:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b301a7c-9d8b-59da-96f3-520d9af662c0 with scrape type 1
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/1.jpg not downloaded yet
2026-03-24 22:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bf510>
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/4.jpg saved to cache
2026-03-24 22:57:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0b90>
2026-03-24 22:57:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/6.jpg saved to cache
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdac90>
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/5.jpg saved to cache
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/2.jpg not downloaded yet
2026-03-24 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/3.jpg not downloaded yet
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/4.jpg not downloaded yet
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008312990>
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/7.jpg saved to cache
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bd290>
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/10.jpg saved to cache
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911da10>
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/9.jpg saved to cache
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/5.jpg not downloaded yet
2026-03-24 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/6.jpg not downloaded yet
2026-03-24 22:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009123b50>
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/1.jpg saved to cache
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009467f50>
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9aa8c35d5ad14d4590766218b5b59a7b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/8.jpg saved to cache
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736
2026-03-24 22:57:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736, skipping ID generation
2026-03-24 22:57:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with scrape type 1
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 sending to next pipeline
2026-03-24 22:57:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736, identifier: 1980544
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/7.jpg not downloaded yet
2026-03-24 22:57:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1980544
2026-03-24 22:57:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1980544
2026-03-24 22:57:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d44b29fe-b0ac-50ce-b5d2-6f0ae726e736 with identifier: 1980544 to the API
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd44b29fe-b0ac-50ce-b5d2-6f0ae726e736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 94681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44b29fe-b0ac-50ce-b5d2-6f0ae726e736/d44b29fe-b0ac-50ce-b5d2-6f0ae726e736_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9aa8c35d5ad14d4590766218b5b59a7b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2023}
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980544%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [ayvens.be] INFO: Saving data for 1980544: {'created_time': 1774393062.22743, 'last_price_update_time': 1774393062.227441, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980544') HTTP/1.1" 204 0
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/8.jpg not downloaded yet
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a2890>
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/2.jpg saved to cache
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914e310>
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/3.jpg saved to cache
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442790>
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/4.jpg saved to cache
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b61290>
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/5.jpg saved to cache
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/9.jpg not downloaded yet
2026-03-24 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/10.jpg not downloaded yet
2026-03-24 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:42 [ayvens.be] INFO: Found listing with ID: 1980547
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980547%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [ayvens.be] INFO: Scrape type for 1980547: 1
2026-03-24 22:57:42 [ayvens.be] INFO: Extracting data for car ID: 1980547
2026-03-24 22:57:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1980547
2026-03-24 22:57:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with scrape type 1
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/1.jpg not downloaded yet
2026-03-24 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/2.jpg not downloaded yet
2026-03-24 22:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/3.jpg not downloaded yet
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/4.jpg not downloaded yet
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00989a9d0>
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/7.jpg saved to cache
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009704dd0>
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/6.jpg saved to cache
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/5.jpg not downloaded yet
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959ce50>
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/9.jpg saved to cache
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978a3d0>
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/8.jpg saved to cache
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/6.jpg not downloaded yet
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/7.jpg not downloaded yet
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959da10>
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252Fdaed263cba5f41d7ae9ae617dbfba049%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/10.jpg saved to cache
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fe3a826-d1b0-5341-92c4-687efe5da057
2026-03-24 22:57:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fe3a826-d1b0-5341-92c4-687efe5da057, skipping ID generation
2026-03-24 22:57:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe3a826-d1b0-5341-92c4-687efe5da057 with scrape type 1
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fe3a826-d1b0-5341-92c4-687efe5da057 sending to next pipeline
2026-03-24 22:57:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1fe3a826-d1b0-5341-92c4-687efe5da057, identifier: 1980545
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b60c90>
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/1.jpg saved to cache
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94e90>
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/2.jpg saved to cache
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cc610>
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/3.jpg saved to cache
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1980545
2026-03-24 22:57:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1980545
2026-03-24 22:57:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1fe3a826-d1b0-5341-92c4-687efe5da057 with identifier: 1980545 to the API
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '1fe3a826-d1b0-5341-92c4-687efe5da057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 110648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe3a826-d1b0-5341-92c4-687efe5da057/1fe3a826-d1b0-5341-92c4-687efe5da057_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/daed263cba5f41d7ae9ae617dbfba049/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980545%27 HTTP/1.1" 200 None
2026-03-24 22:57:43 [ayvens.be] INFO: Saving data for 1980545: {'created_time': 1774393063.861628, 'last_price_update_time': 1774393063.861636, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980545') HTTP/1.1" 204 0
2026-03-24 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/8.jpg not downloaded yet
2026-03-24 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/9.jpg not downloaded yet
2026-03-24 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/10.jpg not downloaded yet
2026-03-24 22:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:43 [ayvens.be] INFO: Found listing with ID: 1980548
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980548%27 HTTP/1.1" 200 None
2026-03-24 22:57:43 [ayvens.be] INFO: Scrape type for 1980548: 1
2026-03-24 22:57:43 [ayvens.be] INFO: Extracting data for car ID: 1980548
2026-03-24 22:57:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1980548
2026-03-24 22:57:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433392de-fd62-5a76-88b4-6ae1052541af with scrape type 1
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/1.jpg not downloaded yet
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/2.jpg not downloaded yet
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/3.jpg not downloaded yet
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145390>
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/5.jpg saved to cache
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/4.jpg not downloaded yet
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b4f10>
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/4.jpg saved to cache
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910cf90>
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/6.jpg saved to cache
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970ee50>
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/8.jpg saved to cache
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916ee10>
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/7.jpg saved to cache
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/5.jpg not downloaded yet
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc5910>
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/9.jpg saved to cache
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd690>
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F2d0b1ba69ace4970b936e79596b92ecb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/10.jpg saved to cache
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b301a7c-9d8b-59da-96f3-520d9af662c0
2026-03-24 22:57:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b301a7c-9d8b-59da-96f3-520d9af662c0, skipping ID generation
2026-03-24 22:57:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b301a7c-9d8b-59da-96f3-520d9af662c0 with scrape type 1
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b301a7c-9d8b-59da-96f3-520d9af662c0 sending to next pipeline
2026-03-24 22:57:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8b301a7c-9d8b-59da-96f3-520d9af662c0, identifier: 1980546
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967ead0>
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/1.jpg saved to cache
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/6.jpg not downloaded yet
2026-03-24 22:57:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8b301a7c-9d8b-59da-96f3-520d9af662c0 with identifier: 1980546
2026-03-24 22:57:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8b301a7c-9d8b-59da-96f3-520d9af662c0 with identifier: 1980546
2026-03-24 22:57:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8b301a7c-9d8b-59da-96f3-520d9af662c0 with identifier: 1980546 to the API
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8b301a7c-9d8b-59da-96f3-520d9af662c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'TARRACO',
 'odometer': 120606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b301a7c-9d8b-59da-96f3-520d9af662c0/8b301a7c-9d8b-59da-96f3-520d9af662c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/2d0b1ba69ace4970b936e79596b92ecb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT TARRACO 1.4 TSI PHEV FR DCT',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV FR DCT',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980546%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [ayvens.be] INFO: Saving data for 1980546: {'created_time': 1774393065.226692, 'last_price_update_time': 1774393065.226702, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980546') HTTP/1.1" 204 0
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/7.jpg not downloaded yet
2026-03-24 22:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/8.jpg not downloaded yet
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/9.jpg not downloaded yet
2026-03-24 22:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/10.jpg not downloaded yet
2026-03-24 22:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:45 [ayvens.be] INFO: Found listing with ID: 1980549
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980549%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [ayvens.be] INFO: Scrape type for 1980549: 1
2026-03-24 22:57:45 [ayvens.be] INFO: Extracting data for car ID: 1980549
2026-03-24 22:57:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with identifier: 1980549
2026-03-24 22:57:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with scrape type 1
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/1.jpg not downloaded yet
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/2.jpg not downloaded yet
2026-03-24 22:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/3.jpg not downloaded yet
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914cad0>
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/2.jpg saved to cache
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917f810>
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/5.jpg saved to cache
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009394510>
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/7.jpg saved to cache
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/4.jpg not downloaded yet
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/5.jpg not downloaded yet
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/6.jpg not downloaded yet
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009872e50>
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/3.jpg saved to cache
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a1fd0>
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/6.jpg saved to cache
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334890>
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/4.jpg saved to cache
2026-03-24 22:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8d90>
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/8.jpg saved to cache
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a1550>
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/4.jpg saved to cache
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/7.jpg not downloaded yet
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/8.jpg not downloaded yet
2026-03-24 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/9.jpg not downloaded yet
2026-03-24 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/10.jpg not downloaded yet
2026-03-24 22:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:46 [ayvens.be] INFO: Found listing with ID: 1980550
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980550%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [ayvens.be] INFO: Scrape type for 1980550: 1
2026-03-24 22:57:46 [ayvens.be] INFO: Extracting data for car ID: 1980550
2026-03-24 22:57:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with identifier: 1980550
2026-03-24 22:57:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with scrape type 1
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/1.jpg not downloaded yet
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/2.jpg not downloaded yet
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/3.jpg not downloaded yet
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/4.jpg not downloaded yet
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d3b50>
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/5.jpg saved to cache
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959cd50>
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/6.jpg saved to cache
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834f350>
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/3.jpg saved to cache
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7210>
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/1.jpg saved to cache
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/5.jpg not downloaded yet
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945eed0>
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/10.jpg saved to cache
2026-03-24 22:57:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009118490>
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/7.jpg saved to cache
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00989ae90>
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/2.jpg saved to cache
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/6.jpg not downloaded yet
2026-03-24 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/7.jpg not downloaded yet
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b297110>
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F62e391170144416b9658f0968b90a20d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/9.jpg saved to cache
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4
2026-03-24 22:57:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4, skipping ID generation
2026-03-24 22:57:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with scrape type 1
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 sending to next pipeline
2026-03-24 22:57:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4, identifier: 1980547
2026-03-24 22:57:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1980547
2026-03-24 22:57:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1980547
2026-03-24 22:57:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a80622f-dbf6-5ccc-a105-af1847b0b8a4 with identifier: 1980547 to the API
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '9a80622f-dbf6-5ccc-a105-af1847b0b8a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 139128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a80622f-dbf6-5ccc-a105-af1847b0b8a4/9a80622f-dbf6-5ccc-a105-af1847b0b8a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/62e391170144416b9658f0968b90a20d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980547%27 HTTP/1.1" 200 None
2026-03-24 22:57:47 [ayvens.be] INFO: Saving data for 1980547: {'created_time': 1774393067.782198, 'last_price_update_time': 1774393067.782209, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980547') HTTP/1.1" 204 0
2026-03-24 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/8.jpg not downloaded yet
2026-03-24 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/9.jpg not downloaded yet
2026-03-24 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441810>
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/1.jpg saved to cache
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094236d0>
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/4.jpg saved to cache
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959e110>
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/5.jpg saved to cache
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/10.jpg not downloaded yet
2026-03-24 22:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:48 [ayvens.be] INFO: Found listing with ID: 1980551
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980551%27 HTTP/1.1" 200 None
2026-03-24 22:57:48 [ayvens.be] INFO: Scrape type for 1980551: 1
2026-03-24 22:57:48 [ayvens.be] INFO: Extracting data for car ID: 1980551
2026-03-24 22:57:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e63084ba-d397-5197-aa10-870246624827 with identifier: 1980551
2026-03-24 22:57:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63084ba-d397-5197-aa10-870246624827 with scrape type 1
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/1.jpg not downloaded yet
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009567e10>
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/3.jpg saved to cache
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6650>
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/10.jpg saved to cache
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b78f10>
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/2.jpg saved to cache
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2690>
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/8.jpg saved to cache
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cf990>
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dt%252Fb6752f93efd44d3fb283ac6a0d1199c3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/9.jpg saved to cache
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 433392de-fd62-5a76-88b4-6ae1052541af
2026-03-24 22:57:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 433392de-fd62-5a76-88b4-6ae1052541af, skipping ID generation
2026-03-24 22:57:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 433392de-fd62-5a76-88b4-6ae1052541af with scrape type 1
2026-03-24 22:57:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 433392de-fd62-5a76-88b4-6ae1052541af sending to next pipeline
2026-03-24 22:57:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 433392de-fd62-5a76-88b4-6ae1052541af, identifier: 1980548
2026-03-24 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1980548
2026-03-24 22:57:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1980548
2026-03-24 22:57:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 433392de-fd62-5a76-88b4-6ae1052541af with identifier: 1980548 to the API
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '433392de-fd62-5a76-88b4-6ae1052541af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 76075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_433392de-fd62-5a76-88b4-6ae1052541af/433392de-fd62-5a76-88b4-6ae1052541af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dt/b6752f93efd44d3fb283ac6a0d1199c3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980548%27 HTTP/1.1" 200 None
2026-03-24 22:57:49 [ayvens.be] INFO: Saving data for 1980548: {'created_time': 1774393069.35516, 'last_price_update_time': 1774393069.35517, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980548') HTTP/1.1" 204 0
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/2.jpg not downloaded yet
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/3.jpg not downloaded yet
2026-03-24 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd250>
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/8.jpg saved to cache
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978aa10>
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/6.jpg saved to cache
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab490>
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/7.jpg saved to cache
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/4.jpg not downloaded yet
2026-03-24 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/5.jpg not downloaded yet
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d03c50>
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/10.jpg saved to cache
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/6.jpg not downloaded yet
2026-03-24 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/7.jpg not downloaded yet
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008347a50>
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/5.jpg saved to cache
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/8.jpg not downloaded yet
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b59d0>
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aa%252F7a16fc0847a54c00947ff77f6ea27d12%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/9.jpg saved to cache
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd
2026-03-24 22:57:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd, skipping ID generation
2026-03-24 22:57:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with scrape type 1
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd sending to next pipeline
2026-03-24 22:57:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd, identifier: 1980549
2026-03-24 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/9.jpg not downloaded yet
2026-03-24 22:57:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with identifier: 1980549
2026-03-24 22:57:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with identifier: 1980549
2026-03-24 22:57:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd with identifier: 1980549 to the API
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 212214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd/4a6a70fa-caa0-5d8b-9ba4-7831e51a23bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aa/7a16fc0847a54c00947ff77f6ea27d12/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980549%27 HTTP/1.1" 200 None
2026-03-24 22:57:50 [ayvens.be] INFO: Saving data for 1980549: {'created_time': 1774393070.52433, 'last_price_update_time': 1774393070.524341, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980549') HTTP/1.1" 204 0
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/10.jpg not downloaded yet
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ccf90>
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/4.jpg saved to cache
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c2750>
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/1.jpg saved to cache
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911e4d0>
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/2.jpg saved to cache
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1a50>
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/3.jpg saved to cache
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:50 [ayvens.be] INFO: Found listing with ID: 1980552
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980552%27 HTTP/1.1" 200 None
2026-03-24 22:57:50 [ayvens.be] INFO: Scrape type for 1980552: 1
2026-03-24 22:57:50 [ayvens.be] INFO: Extracting data for car ID: 1980552
2026-03-24 22:57:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09175781-0ea9-54ed-8020-069176c2cbcf with identifier: 1980552
2026-03-24 22:57:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09175781-0ea9-54ed-8020-069176c2cbcf with scrape type 1
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/1.jpg not downloaded yet
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091327d0>
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/6.jpg saved to cache
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/2.jpg not downloaded yet
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009122490>
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/7.jpg saved to cache
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/3.jpg not downloaded yet
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/4.jpg not downloaded yet
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911dd90>
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/9.jpg saved to cache
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cda50>
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/10.jpg saved to cache
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c9250>
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/1.jpg saved to cache
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd650>
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/2.jpg saved to cache
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962cb10>
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/3.jpg saved to cache
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/5.jpg not downloaded yet
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/6.jpg not downloaded yet
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b5610>
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F92229ed4a75840bca516e65e411687be%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/8.jpg saved to cache
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a
2026-03-24 22:57:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a, skipping ID generation
2026-03-24 22:57:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with scrape type 1
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0a2bd87-4ad2-5dd8-ac63-c2572d48520a sending to next pipeline
2026-03-24 22:57:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a, identifier: 1980550
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2f50>
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/4.jpg saved to cache
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/7.jpg not downloaded yet
2026-03-24 22:57:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with identifier: 1980550
2026-03-24 22:57:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with identifier: 1980550
2026-03-24 22:57:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0a2bd87-4ad2-5dd8-ac63-c2572d48520a with identifier: 1980550 to the API
2026-03-24 22:57:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b0a2bd87-4ad2-5dd8-ac63-c2572d48520a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 77004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a2bd87-4ad2-5dd8-ac63-c2572d48520a/b0a2bd87-4ad2-5dd8-ac63-c2572d48520a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/92229ed4a75840bca516e65e411687be/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980550%27 HTTP/1.1" 200 None
2026-03-24 22:57:52 [ayvens.be] INFO: Saving data for 1980550: {'created_time': 1774393072.150227, 'last_price_update_time': 1774393072.150236, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980550') HTTP/1.1" 204 0
2026-03-24 22:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/8.jpg not downloaded yet
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009146f10>
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/7.jpg saved to cache
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008386990>
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/5.jpg saved to cache
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a93d0>
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/6.jpg saved to cache
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083865d0>
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/9.jpg saved to cache
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440ed0>
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/10.jpg saved to cache
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/9.jpg not downloaded yet
2026-03-24 22:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009397250>
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fa8e1230e180745e8beaac2a6282dac1a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/8.jpg saved to cache
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e63084ba-d397-5197-aa10-870246624827
2026-03-24 22:57:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e63084ba-d397-5197-aa10-870246624827, skipping ID generation
2026-03-24 22:57:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63084ba-d397-5197-aa10-870246624827 with scrape type 1
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e63084ba-d397-5197-aa10-870246624827 sending to next pipeline
2026-03-24 22:57:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e63084ba-d397-5197-aa10-870246624827, identifier: 1980551
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/10.jpg not downloaded yet
2026-03-24 22:57:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e63084ba-d397-5197-aa10-870246624827 with identifier: 1980551
2026-03-24 22:57:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e63084ba-d397-5197-aa10-870246624827 with identifier: 1980551
2026-03-24 22:57:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e63084ba-d397-5197-aa10-870246624827 with identifier: 1980551 to the API
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e63084ba-d397-5197-aa10-870246624827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 145151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e63084ba-d397-5197-aa10-870246624827/e63084ba-d397-5197-aa10-870246624827_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/a8e1230e180745e8beaac2a6282dac1a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980551%27 HTTP/1.1" 200 None
2026-03-24 22:57:52 [ayvens.be] INFO: Saving data for 1980551: {'created_time': 1774393072.944903, 'last_price_update_time': 1774393072.944914, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980551') HTTP/1.1" 204 0
2026-03-24 22:57:52 [ayvens.be] INFO: Found listing with ID: 1980553
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980553%27 HTTP/1.1" 200 None
2026-03-24 22:57:52 [ayvens.be] INFO: Scrape type for 1980553: 1
2026-03-24 22:57:52 [ayvens.be] INFO: Extracting data for car ID: 1980553
2026-03-24 22:57:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ac6c500-e226-5658-a462-5e46731c9c8a with identifier: 1980553
2026-03-24 22:57:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac6c500-e226-5658-a462-5e46731c9c8a with scrape type 1
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/1.jpg not downloaded yet
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d2c50>
2026-03-24 22:57:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/1.jpg saved to cache
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/2.jpg not downloaded yet
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/3.jpg not downloaded yet
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/4.jpg not downloaded yet
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/5.jpg not downloaded yet
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/6.jpg not downloaded yet
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/7.jpg not downloaded yet
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/8.jpg not downloaded yet
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008314d50>
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/2.jpg saved to cache
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f8e50>
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/3.jpg saved to cache
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/9.jpg not downloaded yet
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009459750>
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/4.jpg saved to cache
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f5750>
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/6.jpg saved to cache
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ecd50>
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/5.jpg saved to cache
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/10.jpg not downloaded yet
2026-03-24 22:57:53 [ayvens.be] INFO: Found listing with ID: 1980554
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980554%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [ayvens.be] INFO: Scrape type for 1980554: 1
2026-03-24 22:57:53 [ayvens.be] INFO: Extracting data for car ID: 1980554
2026-03-24 22:57:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1567a852-7480-5a62-9dd2-01b53a6041ac with identifier: 1980554
2026-03-24 22:57:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1567a852-7480-5a62-9dd2-01b53a6041ac with scrape type 1
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/1.jpg not downloaded yet
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdbd90>
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/7.jpg saved to cache
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8f90>
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/8.jpg saved to cache
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00989bad0>
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/9.jpg saved to cache
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/2.jpg not downloaded yet
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/3.jpg not downloaded yet
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/4.jpg not downloaded yet
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/5.jpg not downloaded yet
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/6.jpg not downloaded yet
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009759e10>
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/6.jpg saved to cache
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/7.jpg not downloaded yet
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/8.jpg not downloaded yet
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938e750>
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6c6e6c72303a45a1a949e02754869bfe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/10.jpg saved to cache
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09175781-0ea9-54ed-8020-069176c2cbcf
2026-03-24 22:57:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09175781-0ea9-54ed-8020-069176c2cbcf, skipping ID generation
2026-03-24 22:57:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09175781-0ea9-54ed-8020-069176c2cbcf with scrape type 1
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09175781-0ea9-54ed-8020-069176c2cbcf sending to next pipeline
2026-03-24 22:57:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09175781-0ea9-54ed-8020-069176c2cbcf, identifier: 1980552
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c2890>
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/5.jpg saved to cache
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971b410>
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/2.jpg saved to cache
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967cf90>
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/1.jpg saved to cache
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008345a50>
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/4.jpg saved to cache
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008384a90>
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/3.jpg saved to cache
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfcd50>
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/7.jpg saved to cache
2026-03-24 22:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09175781-0ea9-54ed-8020-069176c2cbcf with identifier: 1980552
2026-03-24 22:57:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09175781-0ea9-54ed-8020-069176c2cbcf with identifier: 1980552
2026-03-24 22:57:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09175781-0ea9-54ed-8020-069176c2cbcf with identifier: 1980552 to the API
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '09175781-0ea9-54ed-8020-069176c2cbcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 35227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09175781-0ea9-54ed-8020-069176c2cbcf/09175781-0ea9-54ed-8020-069176c2cbcf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6c6e6c72303a45a1a949e02754869bfe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 2.0 35 TDI S TRONIC ADVANCED BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC ADVANCED BUSINESS ED',
 'vin': None,
 'year': 2024}
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980552%27 HTTP/1.1" 200 None
2026-03-24 22:57:55 [ayvens.be] INFO: Saving data for 1980552: {'created_time': 1774393075.218256, 'last_price_update_time': 1774393075.218265, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980552') HTTP/1.1" 204 0
2026-03-24 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/9.jpg not downloaded yet
2026-03-24 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/10.jpg not downloaded yet
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097055d0>
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/9.jpg saved to cache
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:55 [ayvens.be] INFO: Found listing with ID: 1980555
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980555%27 HTTP/1.1" 200 None
2026-03-24 22:57:55 [ayvens.be] INFO: Scrape type for 1980555: 1
2026-03-24 22:57:55 [ayvens.be] INFO: Extracting data for car ID: 1980555
2026-03-24 22:57:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8049419-67c0-5a32-90f9-13be3f9a8ad0 with identifier: 1980555
2026-03-24 22:57:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8049419-67c0-5a32-90f9-13be3f9a8ad0 with scrape type 1
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/1.jpg not downloaded yet
2026-03-24 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009704810>
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/8.jpg saved to cache
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/2.jpg not downloaded yet
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983b150>
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fe06e70abaf2f4a7091acb09400c182fb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/10.jpg saved to cache
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ac6c500-e226-5658-a462-5e46731c9c8a
2026-03-24 22:57:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ac6c500-e226-5658-a462-5e46731c9c8a, skipping ID generation
2026-03-24 22:57:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac6c500-e226-5658-a462-5e46731c9c8a with scrape type 1
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ac6c500-e226-5658-a462-5e46731c9c8a sending to next pipeline
2026-03-24 22:57:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3ac6c500-e226-5658-a462-5e46731c9c8a, identifier: 1980553
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/3.jpg not downloaded yet
2026-03-24 22:57:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3ac6c500-e226-5658-a462-5e46731c9c8a with identifier: 1980553
2026-03-24 22:57:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3ac6c500-e226-5658-a462-5e46731c9c8a with identifier: 1980553
2026-03-24 22:57:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3ac6c500-e226-5658-a462-5e46731c9c8a with identifier: 1980553 to the API
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '3ac6c500-e226-5658-a462-5e46731c9c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 156507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ac6c500-e226-5658-a462-5e46731c9c8a/3ac6c500-e226-5658-a462-5e46731c9c8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/e06e70abaf2f4a7091acb09400c182fb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 30 TDI 100KW S TR ATTRACTION BE',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR ATTRACTION BE',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980553%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [ayvens.be] INFO: Saving data for 1980553: {'created_time': 1774393076.025784, 'last_price_update_time': 1774393076.025794, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980553') HTTP/1.1" 204 0
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963abd0>
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/1.jpg saved to cache
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083393d0>
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/2.jpg saved to cache
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009123c50>
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/3.jpg saved to cache
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/4.jpg not downloaded yet
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788d90>
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/4.jpg saved to cache
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/5.jpg not downloaded yet
2026-03-24 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/6.jpg not downloaded yet
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009870450>
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/5.jpg saved to cache
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/7.jpg not downloaded yet
2026-03-24 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/8.jpg not downloaded yet
2026-03-24 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/9.jpg not downloaded yet
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009771690>
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/6.jpg saved to cache
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2a7d0>
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/7.jpg saved to cache
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7010>
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/9.jpg saved to cache
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/10.jpg not downloaded yet
2026-03-24 22:57:56 [ayvens.be] INFO: Found listing with ID: 1980556
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980556%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [ayvens.be] INFO: Scrape type for 1980556: 1
2026-03-24 22:57:56 [ayvens.be] INFO: Extracting data for car ID: 1980556
2026-03-24 22:57:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with identifier: 1980556
2026-03-24 22:57:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with scrape type 1
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/1.jpg not downloaded yet
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639750>
2026-03-24 22:57:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/8.jpg saved to cache
2026-03-24 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f2d0>
2026-03-24 22:57:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ff84170f6dcba4f76a8372f4923a047bb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/10.jpg saved to cache
2026-03-24 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1567a852-7480-5a62-9dd2-01b53a6041ac
2026-03-24 22:57:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1567a852-7480-5a62-9dd2-01b53a6041ac, skipping ID generation
2026-03-24 22:57:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1567a852-7480-5a62-9dd2-01b53a6041ac with scrape type 1
2026-03-24 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1567a852-7480-5a62-9dd2-01b53a6041ac sending to next pipeline
2026-03-24 22:57:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1567a852-7480-5a62-9dd2-01b53a6041ac, identifier: 1980554
2026-03-24 22:57:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d7a90>
2026-03-24 22:57:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/1.jpg saved to cache
2026-03-24 22:57:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1567a852-7480-5a62-9dd2-01b53a6041ac with identifier: 1980554
2026-03-24 22:57:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1567a852-7480-5a62-9dd2-01b53a6041ac with identifier: 1980554
2026-03-24 22:57:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1567a852-7480-5a62-9dd2-01b53a6041ac with identifier: 1980554 to the API
2026-03-24 22:57:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '1567a852-7480-5a62-9dd2-01b53a6041ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Passat',
 'odometer': 133955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1567a852-7480-5a62-9dd2-01b53a6041ac/1567a852-7480-5a62-9dd2-01b53a6041ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/f84170f6dcba4f76a8372f4923a047bb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Passat 2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980554%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [ayvens.be] INFO: Saving data for 1980554: {'created_time': 1774393078.259754, 'last_price_update_time': 1774393078.259765, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980554') HTTP/1.1" 204 0
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/2.jpg not downloaded yet
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963a350>
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/2.jpg saved to cache
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/3.jpg not downloaded yet
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/4.jpg not downloaded yet
2026-03-24 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/5.jpg not downloaded yet
2026-03-24 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/6.jpg not downloaded yet
2026-03-24 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/7.jpg not downloaded yet
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/8.jpg not downloaded yet
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/9.jpg not downloaded yet
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/10.jpg not downloaded yet
2026-03-24 22:57:58 [ayvens.be] INFO: Found listing with ID: 1980557
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980557%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [ayvens.be] INFO: Scrape type for 1980557: 1
2026-03-24 22:57:58 [ayvens.be] INFO: Extracting data for car ID: 1980557
2026-03-24 22:57:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1980557
2026-03-24 22:57:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with scrape type 1
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/1.jpg not downloaded yet
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c1f90>
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/5.jpg saved to cache
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c1310>
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/3.jpg saved to cache
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c1290>
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/6.jpg saved to cache
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bd850>
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/7.jpg saved to cache
2026-03-24 22:57:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099c2110>
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:57:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/9.jpg saved to cache
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/2.jpg not downloaded yet
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009860450>
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/4.jpg saved to cache
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e010>
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/8.jpg saved to cache
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097aa710>
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Faaa45d63e03143e98aaf1b1d57ce2a49%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/10.jpg saved to cache
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8049419-67c0-5a32-90f9-13be3f9a8ad0
2026-03-24 22:57:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8049419-67c0-5a32-90f9-13be3f9a8ad0, skipping ID generation
2026-03-24 22:57:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8049419-67c0-5a32-90f9-13be3f9a8ad0 with scrape type 1
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8049419-67c0-5a32-90f9-13be3f9a8ad0 sending to next pipeline
2026-03-24 22:57:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8049419-67c0-5a32-90f9-13be3f9a8ad0, identifier: 1980555
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/3.jpg not downloaded yet
2026-03-24 22:57:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8049419-67c0-5a32-90f9-13be3f9a8ad0 with identifier: 1980555
2026-03-24 22:57:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8049419-67c0-5a32-90f9-13be3f9a8ad0 with identifier: 1980555
2026-03-24 22:57:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8049419-67c0-5a32-90f9-13be3f9a8ad0 with identifier: 1980555 to the API
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:57:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e8049419-67c0-5a32-90f9-13be3f9a8ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 127193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8049419-67c0-5a32-90f9-13be3f9a8ad0/e8049419-67c0-5a32-90f9-13be3f9a8ad0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/aaa45d63e03143e98aaf1b1d57ce2a49/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.5 BLUEHDI 130 S&S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980555%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [ayvens.be] INFO: Saving data for 1980555: {'created_time': 1774393079.702204, 'last_price_update_time': 1774393079.702213, 'auction_closing_time': 1774530000.0}
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980555') HTTP/1.1" 204 0
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/4.jpg not downloaded yet
2026-03-24 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/5.jpg not downloaded yet
2026-03-24 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/6.jpg not downloaded yet
2026-03-24 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/7.jpg not downloaded yet
2026-03-24 22:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/8.jpg not downloaded yet
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/9.jpg not downloaded yet
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/10.jpg not downloaded yet
2026-03-24 22:57:59 [ayvens.be] INFO: Found listing with ID: 1980558
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980558%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [ayvens.be] INFO: Scrape type for 1980558: 1
2026-03-24 22:57:59 [ayvens.be] INFO: Extracting data for car ID: 1980558
2026-03-24 22:57:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1980558
2026-03-24 22:57:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with scrape type 1
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:57:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/1.jpg not downloaded yet
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091437d0>
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:57:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:57:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/3.jpg saved to cache
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/2.jpg not downloaded yet
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b9890>
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/2.jpg saved to cache
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cca50>
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/1.jpg saved to cache
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093973d0>
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/6.jpg saved to cache
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009141910>
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/4.jpg saved to cache
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187050>
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/5.jpg saved to cache
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009405c10>
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/7.jpg saved to cache
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/3.jpg not downloaded yet
2026-03-24 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/4.jpg not downloaded yet
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008310a90>
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/8.jpg saved to cache
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/5.jpg not downloaded yet
2026-03-24 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/6.jpg not downloaded yet
2026-03-24 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfe510>
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/9.jpg saved to cache
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/7.jpg not downloaded yet
2026-03-24 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/8.jpg not downloaded yet
2026-03-24 22:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/9.jpg not downloaded yet
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009861290>
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F29e264fbf1ea4896a187128c3e319d2d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/10.jpg saved to cache
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8
2026-03-24 22:58:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8, skipping ID generation
2026-03-24 22:58:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with scrape type 1
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 sending to next pipeline
2026-03-24 22:58:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8, identifier: 1980556
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f5210>
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/1.jpg saved to cache
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with identifier: 1980556
2026-03-24 22:58:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with identifier: 1980556
2026-03-24 22:58:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 438d6f36-9e95-56f4-aabe-ce1ba17d0ad8 with identifier: 1980556 to the API
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '438d6f36-9e95-56f4-aabe-ce1ba17d0ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 TOURING DIESEL - 2019',
 'odometer': 175892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438d6f36-9e95-56f4-aabe-ce1ba17d0ad8/438d6f36-9e95-56f4-aabe-ce1ba17d0ad8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/29e264fbf1ea4896a187128c3e319d2d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 TOURING DIESEL - 2019 320 d AdBlue',
 'transmission': 'manual',
 'trim': '320 d AdBlue',
 'vin': None,
 'year': 2020}
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980556%27 HTTP/1.1" 200 None
2026-03-24 22:58:01 [ayvens.be] INFO: Saving data for 1980556: {'created_time': 1774393081.537488, 'last_price_update_time': 1774393081.537497, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980556') HTTP/1.1" 204 0
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/10.jpg not downloaded yet
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cc910>
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/5.jpg saved to cache
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f82d0>
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/2.jpg saved to cache
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c3ed0>
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/6.jpg saved to cache
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:01 [ayvens.be] INFO: Found listing with ID: 1980559
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980559%27 HTTP/1.1" 200 None
2026-03-24 22:58:01 [ayvens.be] INFO: Scrape type for 1980559: 1
2026-03-24 22:58:01 [ayvens.be] INFO: Extracting data for car ID: 1980559
2026-03-24 22:58:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1980559
2026-03-24 22:58:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76552fd3-b338-580f-b2a5-4128d2e47df3 with scrape type 1
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/1.jpg not downloaded yet
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009898690>
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/3.jpg saved to cache
2026-03-24 22:58:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095ec590>
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/4.jpg saved to cache
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/2.jpg not downloaded yet
2026-03-24 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/3.jpg not downloaded yet
2026-03-24 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/4.jpg not downloaded yet
2026-03-24 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/5.jpg not downloaded yet
2026-03-24 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/6.jpg not downloaded yet
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/7.jpg not downloaded yet
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/8.jpg not downloaded yet
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/9.jpg not downloaded yet
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008316510>
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/1.jpg saved to cache
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00989a750>
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/7.jpg saved to cache
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009155850>
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/10.jpg saved to cache
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b1d0>
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/9.jpg saved to cache
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094204d0>
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/3.jpg saved to cache
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b110>
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/2.jpg saved to cache
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b46710>
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F119d10590dd74b208fd795c0a12db45b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/8.jpg saved to cache
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1
2026-03-24 22:58:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1, skipping ID generation
2026-03-24 22:58:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with scrape type 1
2026-03-24 22:58:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 sending to next pipeline
2026-03-24 22:58:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1, identifier: 1980557
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008344490>
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/4.jpg saved to cache
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/10.jpg not downloaded yet
2026-03-24 22:58:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1980557
2026-03-24 22:58:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1980557
2026-03-24 22:58:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 183a01eb-ba00-5b6a-8f49-a0247b53e1f1 with identifier: 1980557 to the API
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '183a01eb-ba00-5b6a-8f49-a0247b53e1f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 76834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 886726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_183a01eb-ba00-5b6a-8f49-a0247b53e1f1/183a01eb-ba00-5b6a-8f49-a0247b53e1f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/119d10590dd74b208fd795c0a12db45b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980557%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [ayvens.be] INFO: Saving data for 1980557: {'created_time': 1774393083.510673, 'last_price_update_time': 1774393083.510683, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980557') HTTP/1.1" 204 0
2026-03-24 22:58:03 [ayvens.be] INFO: Found listing with ID: 1980560
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980560%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [ayvens.be] INFO: Scrape type for 1980560: 1
2026-03-24 22:58:03 [ayvens.be] INFO: Extracting data for car ID: 1980560
2026-03-24 22:58:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1 with identifier: 1980560
2026-03-24 22:58:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1 with scrape type 1
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/1.jpg not downloaded yet
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/2.jpg not downloaded yet
2026-03-24 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/3.jpg not downloaded yet
2026-03-24 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/4.jpg not downloaded yet
2026-03-24 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/5.jpg not downloaded yet
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/6.jpg not downloaded yet
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/7.jpg not downloaded yet
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/8.jpg not downloaded yet
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/9.jpg not downloaded yet
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b4fd0>
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/5.jpg saved to cache
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187a50>
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/1.jpg saved to cache
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945e3d0>
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/7.jpg saved to cache
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643310>
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/2.jpg saved to cache
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/10.jpg not downloaded yet
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a9e50>
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/6.jpg saved to cache
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8790>
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/10.jpg saved to cache
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638110>
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/9.jpg saved to cache
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfdad0>
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F8b8de9ea90cd4400b4432b9b07a55d66%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/8.jpg saved to cache
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8
2026-03-24 22:58:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8, skipping ID generation
2026-03-24 22:58:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with scrape type 1
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 sending to next pipeline
2026-03-24 22:58:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8, identifier: 1980558
2026-03-24 22:58:04 [ayvens.be] INFO: Found listing with ID: 1980561
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980561%27 HTTP/1.1" 200 None
2026-03-24 22:58:04 [ayvens.be] INFO: Scrape type for 1980561: 1
2026-03-24 22:58:04 [ayvens.be] INFO: Extracting data for car ID: 1980561
2026-03-24 22:58:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1980561
2026-03-24 22:58:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00349aad-9198-5bb8-b310-8af076348f0e with scrape type 1
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/1.jpg not downloaded yet
2026-03-24 22:58:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1980558
2026-03-24 22:58:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1980558
2026-03-24 22:58:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f5f974a-0766-52a4-afdb-ae60ea21c7a8 with identifier: 1980558 to the API
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f5f974a-0766-52a4-afdb-ae60ea21c7a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'LEON ST',
 'odometer': 97512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f5f974a-0766-52a4-afdb-ae60ea21c7a8/0f5f974a-0766-52a4-afdb-ae60ea21c7a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/8b8de9ea90cd4400b4432b9b07a55d66/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA LEON ST 1.4 PHEV E-HYBRID 150KW DSG SP',
 'transmission': 'automatic',
 'trim': '1.4 PHEV E-HYBRID 150KW DSG SP',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980558%27 HTTP/1.1" 200 None
2026-03-24 22:58:04 [ayvens.be] INFO: Saving data for 1980558: {'created_time': 1774393084.947763, 'last_price_update_time': 1774393084.947773, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980558') HTTP/1.1" 204 0
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/2.jpg not downloaded yet
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/3.jpg not downloaded yet
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/4.jpg not downloaded yet
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/5.jpg not downloaded yet
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/6.jpg not downloaded yet
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/7.jpg not downloaded yet
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/8.jpg not downloaded yet
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/9.jpg not downloaded yet
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/10.jpg not downloaded yet
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317890>
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/6.jpg saved to cache
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [ayvens.be] INFO: Found listing with ID: 1980562
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980562%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [ayvens.be] INFO: Scrape type for 1980562: 1
2026-03-24 22:58:05 [ayvens.be] INFO: Extracting data for car ID: 1980562
2026-03-24 22:58:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6785017-edfe-5f6c-af6a-3220a9f12ca1 with identifier: 1980562
2026-03-24 22:58:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6785017-edfe-5f6c-af6a-3220a9f12ca1 with scrape type 1
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/1.jpg not downloaded yet
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382890>
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/5.jpg saved to cache
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912a410>
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/4.jpg saved to cache
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009706a10>
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/7.jpg saved to cache
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095bf310>
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/3.jpg saved to cache
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/2.jpg not downloaded yet
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/3.jpg not downloaded yet
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009566890>
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/10.jpg saved to cache
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963bd10>
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/8.jpg saved to cache
2026-03-24 22:58:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959ffd0>
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F9635ba0096cd4b048f987dc369e3dbdd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/9.jpg saved to cache
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76552fd3-b338-580f-b2a5-4128d2e47df3
2026-03-24 22:58:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76552fd3-b338-580f-b2a5-4128d2e47df3, skipping ID generation
2026-03-24 22:58:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76552fd3-b338-580f-b2a5-4128d2e47df3 with scrape type 1
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76552fd3-b338-580f-b2a5-4128d2e47df3 sending to next pipeline
2026-03-24 22:58:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 76552fd3-b338-580f-b2a5-4128d2e47df3, identifier: 1980559
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b1690>
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/1.jpg saved to cache
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00938e190>
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/2.jpg saved to cache
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1980559
2026-03-24 22:58:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1980559
2026-03-24 22:58:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 76552fd3-b338-580f-b2a5-4128d2e47df3 with identifier: 1980559 to the API
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '76552fd3-b338-580f-b2a5-4128d2e47df3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 92640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76552fd3-b338-580f-b2a5-4128d2e47df3/76552fd3-b338-580f-b2a5-4128d2e47df3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/9635ba0096cd4b048f987dc369e3dbdd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S STYLE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S STYLE',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980559%27 HTTP/1.1" 200 None
2026-03-24 22:58:06 [ayvens.be] INFO: Saving data for 1980559: {'created_time': 1774393086.568541, 'last_price_update_time': 1774393086.568553, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980559') HTTP/1.1" 204 0
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/4.jpg not downloaded yet
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/5.jpg not downloaded yet
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639f10>
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/3.jpg saved to cache
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fac10>
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/9.jpg saved to cache
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967df50>
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/8.jpg saved to cache
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c5f50>
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/6.jpg saved to cache
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008342350>
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/7.jpg saved to cache
2026-03-24 22:58:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c1410>
2026-03-24 22:58:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/10.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at -6 pages/min), scraped 549 items (at 38 items/min)
2026-03-24 22:58:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/6.jpg not downloaded yet
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/7.jpg not downloaded yet
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/8.jpg not downloaded yet
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/9.jpg not downloaded yet
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/10.jpg not downloaded yet
2026-03-24 22:58:07 [ayvens.be] INFO: Found listing with ID: 1980563
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980563%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [ayvens.be] INFO: Scrape type for 1980563: 1
2026-03-24 22:58:07 [ayvens.be] INFO: Extracting data for car ID: 1980563
2026-03-24 22:58:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcb94b69-fc8d-5462-932e-5e54a021f291 with identifier: 1980563
2026-03-24 22:58:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb94b69-fc8d-5462-932e-5e54a021f291 with scrape type 1
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/1.jpg not downloaded yet
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/2.jpg not downloaded yet
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083c0a50>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/5.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098b7d90>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/4.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009702ed0>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/3.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/3.jpg not downloaded yet
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008358710>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/2.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b3850>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/1.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/4.jpg not downloaded yet
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/5.jpg not downloaded yet
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008371550>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/1.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/6.jpg not downloaded yet
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/7.jpg not downloaded yet
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d01310>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/10.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009397310>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/2.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d5b10>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/9.jpg saved to cache
2026-03-24 22:58:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093946d0>
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/6.jpg saved to cache
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440510>
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/3.jpg saved to cache
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1ba0d0>
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/8.jpg saved to cache
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/8.jpg not downloaded yet
2026-03-24 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/9.jpg not downloaded yet
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/10.jpg not downloaded yet
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f2a10>
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/7.jpg saved to cache
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:08 [ayvens.be] INFO: Found listing with ID: 1980564
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980564%27 HTTP/1.1" 200 None
2026-03-24 22:58:08 [ayvens.be] INFO: Scrape type for 1980564: 1
2026-03-24 22:58:08 [ayvens.be] INFO: Extracting data for car ID: 1980564
2026-03-24 22:58:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1980564
2026-03-24 22:58:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 735aded9-be81-558c-a6a9-efc2b66de218 with scrape type 1
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/1.jpg not downloaded yet
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/2.jpg not downloaded yet
2026-03-24 22:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083364d0>
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F2d51d17c808e498eae0685752b5dc0c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/5.jpg saved to cache
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00349aad-9198-5bb8-b310-8af076348f0e
2026-03-24 22:58:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00349aad-9198-5bb8-b310-8af076348f0e, skipping ID generation
2026-03-24 22:58:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00349aad-9198-5bb8-b310-8af076348f0e with scrape type 1
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00349aad-9198-5bb8-b310-8af076348f0e sending to next pipeline
2026-03-24 22:58:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00349aad-9198-5bb8-b310-8af076348f0e, identifier: 1980561
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091309d0>
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ff1e8e1438409455eba31da462ca5559e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/4.jpg saved to cache
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1
2026-03-24 22:58:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1, skipping ID generation
2026-03-24 22:58:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1 with scrape type 1
2026-03-24 22:58:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1 sending to next pipeline
2026-03-24 22:58:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1, identifier: 1980560
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094714d0>
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/5.jpg saved to cache
2026-03-24 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639b50>
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/4.jpg saved to cache
2026-03-24 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/3.jpg not downloaded yet
2026-03-24 22:58:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1980561
2026-03-24 22:58:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1980561
2026-03-24 22:58:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00349aad-9198-5bb8-b310-8af076348f0e with identifier: 1980561 to the API
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '00349aad-9198-5bb8-b310-8af076348f0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 85166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00349aad-9198-5bb8-b310-8af076348f0e/00349aad-9198-5bb8-b310-8af076348f0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/2d51d17c808e498eae0685752b5dc0c6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980561%27 HTTP/1.1" 200 None
2026-03-24 22:58:09 [ayvens.be] INFO: Saving data for 1980561: {'created_time': 1774393089.554974, 'last_price_update_time': 1774393089.554983, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980561') HTTP/1.1" 204 0
2026-03-24 22:58:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1 with identifier: 1980560
2026-03-24 22:58:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1 with identifier: 1980560
2026-03-24 22:58:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7c5dd6e0-1898-5111-90dc-b7b5750fc7a1 with identifier: 1980560 to the API
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '7c5dd6e0-1898-5111-90dc-b7b5750fc7a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 115673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c5dd6e0-1898-5111-90dc-b7b5750fc7a1/7c5dd6e0-1898-5111-90dc-b7b5750fc7a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/f1e8e1438409455eba31da462ca5559e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 1.5 TSI OPF VARIANT STYLE BUSINESS',
 'transmission': 'manual',
 'trim': '1.5 TSI OPF VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980560%27 HTTP/1.1" 200 None
2026-03-24 22:58:09 [ayvens.be] INFO: Saving data for 1980560: {'created_time': 1774393089.872085, 'last_price_update_time': 1774393089.872094, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980560') HTTP/1.1" 204 0
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/4.jpg not downloaded yet
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/5.jpg not downloaded yet
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c5350>
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/7.jpg saved to cache
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978af50>
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/6.jpg saved to cache
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093da2d0>
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/8.jpg saved to cache
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978b650>
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/9.jpg saved to cache
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b46750>
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F5de07405ca0e4f438fb25344001d6c14%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/10.jpg saved to cache
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6785017-edfe-5f6c-af6a-3220a9f12ca1
2026-03-24 22:58:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6785017-edfe-5f6c-af6a-3220a9f12ca1, skipping ID generation
2026-03-24 22:58:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6785017-edfe-5f6c-af6a-3220a9f12ca1 with scrape type 1
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6785017-edfe-5f6c-af6a-3220a9f12ca1 sending to next pipeline
2026-03-24 22:58:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6785017-edfe-5f6c-af6a-3220a9f12ca1, identifier: 1980562
2026-03-24 22:58:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6785017-edfe-5f6c-af6a-3220a9f12ca1 with identifier: 1980562
2026-03-24 22:58:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6785017-edfe-5f6c-af6a-3220a9f12ca1 with identifier: 1980562
2026-03-24 22:58:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6785017-edfe-5f6c-af6a-3220a9f12ca1 with identifier: 1980562 to the API
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b6785017-edfe-5f6c-af6a-3220a9f12ca1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 82885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6785017-edfe-5f6c-af6a-3220a9f12ca1/b6785017-edfe-5f6c-af6a-3220a9f12ca1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/5de07405ca0e4f438fb25344001d6c14/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980562%27 HTTP/1.1" 200 None
2026-03-24 22:58:10 [ayvens.be] INFO: Saving data for 1980562: {'created_time': 1774393090.69799, 'last_price_update_time': 1774393090.697999, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980562') HTTP/1.1" 204 0
2026-03-24 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/6.jpg not downloaded yet
2026-03-24 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/7.jpg not downloaded yet
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/8.jpg not downloaded yet
2026-03-24 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/9.jpg not downloaded yet
2026-03-24 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/10.jpg not downloaded yet
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121bd0>
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/2.jpg saved to cache
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:10 [ayvens.be] INFO: Found listing with ID: 1980565
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980565%27 HTTP/1.1" 200 None
2026-03-24 22:58:10 [ayvens.be] INFO: Scrape type for 1980565: 1
2026-03-24 22:58:10 [ayvens.be] INFO: Extracting data for car ID: 1980565
2026-03-24 22:58:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f21961b-29df-52e4-9091-d40715466cfd with identifier: 1980565
2026-03-24 22:58:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f21961b-29df-52e4-9091-d40715466cfd with scrape type 1
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/1.jpg not downloaded yet
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/2.jpg not downloaded yet
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/3.jpg not downloaded yet
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be490>
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/3.jpg saved to cache
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096131d0>
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/7.jpg saved to cache
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeafcd0>
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/1.jpg saved to cache
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94e90>
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/4.jpg saved to cache
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912bcd0>
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/5.jpg saved to cache
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900a4d0>
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/6.jpg saved to cache
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788f10>
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/8.jpg saved to cache
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/4.jpg not downloaded yet
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/5.jpg not downloaded yet
2026-03-24 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/6.jpg not downloaded yet
2026-03-24 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/7.jpg not downloaded yet
2026-03-24 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/8.jpg not downloaded yet
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/9.jpg not downloaded yet
2026-03-24 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/10.jpg not downloaded yet
2026-03-24 22:58:11 [ayvens.be] INFO: Found listing with ID: 1980566
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980566%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [ayvens.be] INFO: Scrape type for 1980566: 1
2026-03-24 22:58:11 [ayvens.be] INFO: Extracting data for car ID: 1980566
2026-03-24 22:58:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with identifier: 1980566
2026-03-24 22:58:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with scrape type 1
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/1.jpg not downloaded yet
2026-03-24 22:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/2.jpg not downloaded yet
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/3.jpg not downloaded yet
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911bc10>
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/9.jpg saved to cache
2026-03-24 22:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970fbd0>
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/1.jpg saved to cache
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00970c6d0>
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/5.jpg saved to cache
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2c710>
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/3.jpg saved to cache
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009130f90>
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/4.jpg saved to cache
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/4.jpg not downloaded yet
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e450>
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xr%252F56d8941aa164403b89ffeb44ddec615b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/10.jpg saved to cache
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcb94b69-fc8d-5462-932e-5e54a021f291
2026-03-24 22:58:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcb94b69-fc8d-5462-932e-5e54a021f291, skipping ID generation
2026-03-24 22:58:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb94b69-fc8d-5462-932e-5e54a021f291 with scrape type 1
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcb94b69-fc8d-5462-932e-5e54a021f291 sending to next pipeline
2026-03-24 22:58:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fcb94b69-fc8d-5462-932e-5e54a021f291, identifier: 1980563
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2b1d0>
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/2.jpg saved to cache
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009144090>
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/6.jpg saved to cache
2026-03-24 22:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fcb94b69-fc8d-5462-932e-5e54a021f291 with identifier: 1980563
2026-03-24 22:58:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fcb94b69-fc8d-5462-932e-5e54a021f291 with identifier: 1980563
2026-03-24 22:58:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fcb94b69-fc8d-5462-932e-5e54a021f291 with identifier: 1980563 to the API
2026-03-24 22:58:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fcb94b69-fc8d-5462-932e-5e54a021f291',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO V',
 'odometer': 84446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcb94b69-fc8d-5462-932e-5e54a021f291/fcb94b69-fc8d-5462-932e-5e54a021f291_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xr/56d8941aa164403b89ffeb44ddec615b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO V 1.0 TCe Corporate Edition (Fleet)',
 'transmission': 'manual',
 'trim': '1.0 TCe Corporate Edition (Fleet)',
 'vin': None,
 'year': 2020}
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980563%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [ayvens.be] INFO: Saving data for 1980563: {'created_time': 1774393093.132385, 'last_price_update_time': 1774393093.132394, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980563') HTTP/1.1" 204 0
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/5.jpg not downloaded yet
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091acbd0>
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/4.jpg saved to cache
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a8890>
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/2.jpg saved to cache
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009704d50>
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/1.jpg saved to cache
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/6.jpg not downloaded yet
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/7.jpg not downloaded yet
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/8.jpg not downloaded yet
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009565c50>
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/5.jpg saved to cache
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009184350>
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/3.jpg saved to cache
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091205d0>
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/7.jpg saved to cache
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/9.jpg not downloaded yet
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/10.jpg not downloaded yet
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b53a50>
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/10.jpg saved to cache
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945fa50>
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/9.jpg saved to cache
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [ayvens.be] INFO: Found listing with ID: 1980567
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980567%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [ayvens.be] INFO: Scrape type for 1980567: 1
2026-03-24 22:58:13 [ayvens.be] INFO: Extracting data for car ID: 1980567
2026-03-24 22:58:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with identifier: 1980567
2026-03-24 22:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with scrape type 1
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/1.jpg not downloaded yet
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/2.jpg not downloaded yet
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/3.jpg not downloaded yet
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cffc90>
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252F234d4401b13b43478b0f718feaebd815%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/8.jpg saved to cache
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 735aded9-be81-558c-a6a9-efc2b66de218
2026-03-24 22:58:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 735aded9-be81-558c-a6a9-efc2b66de218, skipping ID generation
2026-03-24 22:58:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 735aded9-be81-558c-a6a9-efc2b66de218 with scrape type 1
2026-03-24 22:58:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 735aded9-be81-558c-a6a9-efc2b66de218 sending to next pipeline
2026-03-24 22:58:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 735aded9-be81-558c-a6a9-efc2b66de218, identifier: 1980564
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945f190>
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/10.jpg saved to cache
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1980564
2026-03-24 22:58:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1980564
2026-03-24 22:58:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 735aded9-be81-558c-a6a9-efc2b66de218 with identifier: 1980564 to the API
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '735aded9-be81-558c-a6a9-efc2b66de218',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 128479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735aded9-be81-558c-a6a9-efc2b66de218/735aded9-be81-558c-a6a9-efc2b66de218_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/234d4401b13b43478b0f718feaebd815/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 250 E BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 B 250 E BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980564%27 HTTP/1.1" 200 None
2026-03-24 22:58:14 [ayvens.be] INFO: Saving data for 1980564: {'created_time': 1774393094.425388, 'last_price_update_time': 1774393094.425398, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980564') HTTP/1.1" 204 0
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/4.jpg not downloaded yet
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/5.jpg not downloaded yet
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cd9a50>
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/9.jpg saved to cache
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1ba410>
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/1.jpg saved to cache
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d6750>
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/3.jpg saved to cache
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442810>
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/2.jpg saved to cache
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019b10>
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/8.jpg saved to cache
2026-03-24 22:58:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009493310>
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/7.jpg saved to cache
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d6410>
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F6eca647261f842a8a3d8889b5dd3f400%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/6.jpg saved to cache
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f21961b-29df-52e4-9091-d40715466cfd
2026-03-24 22:58:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f21961b-29df-52e4-9091-d40715466cfd, skipping ID generation
2026-03-24 22:58:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f21961b-29df-52e4-9091-d40715466cfd with scrape type 1
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f21961b-29df-52e4-9091-d40715466cfd sending to next pipeline
2026-03-24 22:58:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4f21961b-29df-52e4-9091-d40715466cfd, identifier: 1980565
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/6.jpg not downloaded yet
2026-03-24 22:58:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4f21961b-29df-52e4-9091-d40715466cfd with identifier: 1980565
2026-03-24 22:58:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4f21961b-29df-52e4-9091-d40715466cfd with identifier: 1980565
2026-03-24 22:58:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4f21961b-29df-52e4-9091-d40715466cfd with identifier: 1980565 to the API
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '4f21961b-29df-52e4-9091-d40715466cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 137513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f21961b-29df-52e4-9091-d40715466cfd/4f21961b-29df-52e4-9091-d40715466cfd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/6eca647261f842a8a3d8889b5dd3f400/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980565%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [ayvens.be] INFO: Saving data for 1980565: {'created_time': 1774393095.576908, 'last_price_update_time': 1774393095.576918, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980565') HTTP/1.1" 204 0
2026-03-24 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/7.jpg not downloaded yet
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/8.jpg not downloaded yet
2026-03-24 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/9.jpg not downloaded yet
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/10.jpg not downloaded yet
2026-03-24 22:58:15 [ayvens.be] INFO: Found listing with ID: 1980568
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980568%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [ayvens.be] INFO: Scrape type for 1980568: 1
2026-03-24 22:58:15 [ayvens.be] INFO: Extracting data for car ID: 1980568
2026-03-24 22:58:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6479a13-66d2-51e7-b80a-e69b1d185324 with identifier: 1980568
2026-03-24 22:58:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6479a13-66d2-51e7-b80a-e69b1d185324 with scrape type 1
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/1.jpg not downloaded yet
2026-03-24 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be590>
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/4.jpg saved to cache
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/2.jpg not downloaded yet
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/3.jpg not downloaded yet
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/4.jpg not downloaded yet
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cfdd0>
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/7.jpg saved to cache
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aa710>
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/9.jpg saved to cache
2026-03-24 22:58:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096128d0>
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/5.jpg saved to cache
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bc110>
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/8.jpg saved to cache
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f1b50>
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/6.jpg saved to cache
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/5.jpg not downloaded yet
2026-03-24 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959c990>
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252F932b73a796a845fda5a37d4bcffe15f8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/10.jpg saved to cache
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8
2026-03-24 22:58:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8, skipping ID generation
2026-03-24 22:58:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with scrape type 1
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 sending to next pipeline
2026-03-24 22:58:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8, identifier: 1980566
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a8bd0>
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/1.jpg saved to cache
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/6.jpg not downloaded yet
2026-03-24 22:58:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with identifier: 1980566
2026-03-24 22:58:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with identifier: 1980566
2026-03-24 22:58:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8 with identifier: 1980566 to the API
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 87882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8/b75e7a9a-8fdf-5e28-bbbd-e7abbd5f15c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/932b73a796a845fda5a37d4bcffe15f8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980566%27 HTTP/1.1" 200 None
2026-03-24 22:58:16 [ayvens.be] INFO: Saving data for 1980566: {'created_time': 1774393096.837282, 'last_price_update_time': 1774393096.837293, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980566') HTTP/1.1" 204 0
2026-03-24 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/7.jpg not downloaded yet
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a2dd0>
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/2.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/8.jpg not downloaded yet
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/9.jpg not downloaded yet
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b0e90>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/6.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/10.jpg not downloaded yet
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095eebd0>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/7.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8550>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/5.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:17 [ayvens.be] INFO: Found listing with ID: 1980569
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980569%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [ayvens.be] INFO: Scrape type for 1980569: 1
2026-03-24 22:58:17 [ayvens.be] INFO: Extracting data for car ID: 1980569
2026-03-24 22:58:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 475ee9c4-092b-5843-b6ad-2aa8911b972e with identifier: 1980569
2026-03-24 22:58:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 475ee9c4-092b-5843-b6ad-2aa8911b972e with scrape type 1
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/1.jpg not downloaded yet
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/2.jpg not downloaded yet
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945ba10>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/3.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914e550>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/4.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008368cd0>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/9.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009472290>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/2.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9c90>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/8.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/3.jpg not downloaded yet
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/4.jpg not downloaded yet
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095f9050>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/1.jpg saved to cache
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/5.jpg not downloaded yet
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/6.jpg not downloaded yet
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/7.jpg not downloaded yet
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009707590>
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/3.jpg saved to cache
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2ed0>
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/5.jpg saved to cache
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083aafd0>
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/4.jpg saved to cache
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083abfd0>
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/6.jpg saved to cache
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d5410>
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/7.jpg saved to cache
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/8.jpg not downloaded yet
2026-03-24 22:58:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/9.jpg not downloaded yet
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a59d0>
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fd7982d125f994486bf666b005d70669f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/10.jpg saved to cache
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79
2026-03-24 22:58:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79, skipping ID generation
2026-03-24 22:58:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with scrape type 1
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 sending to next pipeline
2026-03-24 22:58:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79, identifier: 1980567
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d947d0>
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/8.jpg saved to cache
2026-03-24 22:58:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with identifier: 1980567
2026-03-24 22:58:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with identifier: 1980567
2026-03-24 22:58:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79 with identifier: 1980567 to the API
2026-03-24 22:58:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 107217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79/d1b2a6bf-e004-5c5f-a6a1-3bd7a0568c79_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/d7982d125f994486bf666b005d70669f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980567%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [ayvens.be] INFO: Saving data for 1980567: {'created_time': 1774393099.188477, 'last_price_update_time': 1774393099.188487, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980567') HTTP/1.1" 204 0
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/10.jpg not downloaded yet
2026-03-24 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:19 [ayvens.be] INFO: Found listing with ID: 1980570
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980570%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [ayvens.be] INFO: Scrape type for 1980570: 1
2026-03-24 22:58:19 [ayvens.be] INFO: Extracting data for car ID: 1980570
2026-03-24 22:58:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1980570
2026-03-24 22:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59e1dc1-9407-5451-af2c-f810e89334ef with scrape type 1
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/1.jpg not downloaded yet
2026-03-24 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009186650>
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/10.jpg saved to cache
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/2.jpg not downloaded yet
2026-03-24 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/3.jpg not downloaded yet
2026-03-24 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/4.jpg not downloaded yet
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/5.jpg not downloaded yet
2026-03-24 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946fa50>
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc427b96e791b4dd0976652579266a771%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/9.jpg saved to cache
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6479a13-66d2-51e7-b80a-e69b1d185324
2026-03-24 22:58:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6479a13-66d2-51e7-b80a-e69b1d185324, skipping ID generation
2026-03-24 22:58:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6479a13-66d2-51e7-b80a-e69b1d185324 with scrape type 1
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6479a13-66d2-51e7-b80a-e69b1d185324 sending to next pipeline
2026-03-24 22:58:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6479a13-66d2-51e7-b80a-e69b1d185324, identifier: 1980568
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/6.jpg not downloaded yet
2026-03-24 22:58:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6479a13-66d2-51e7-b80a-e69b1d185324 with identifier: 1980568
2026-03-24 22:58:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6479a13-66d2-51e7-b80a-e69b1d185324 with identifier: 1980568
2026-03-24 22:58:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6479a13-66d2-51e7-b80a-e69b1d185324 with identifier: 1980568 to the API
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 47,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b6479a13-66d2-51e7-b80a-e69b1d185324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 104277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6479a13-66d2-51e7-b80a-e69b1d185324/b6479a13-66d2-51e7-b80a-e69b1d185324_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c427b96e791b4dd0976652579266a771/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV Inscription Expres.',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV Inscription Expres.',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980568%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [ayvens.be] INFO: Saving data for 1980568: {'created_time': 1774393099.86701, 'last_price_update_time': 1774393099.86702, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980568') HTTP/1.1" 204 0
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fb010>
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/1.jpg saved to cache
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/7.jpg not downloaded yet
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a95d0>
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/2.jpg saved to cache
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2b190>
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/5.jpg saved to cache
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915fc10>
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/3.jpg saved to cache
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917e6d0>
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/4.jpg saved to cache
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913cbd0>
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/6.jpg saved to cache
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019a90>
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/7.jpg saved to cache
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/8.jpg not downloaded yet
2026-03-24 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/9.jpg not downloaded yet
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/10.jpg not downloaded yet
2026-03-24 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:20 [ayvens.be] INFO: Found listing with ID: 1980571
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980571%27 HTTP/1.1" 200 None
2026-03-24 22:58:20 [ayvens.be] INFO: Scrape type for 1980571: 1
2026-03-24 22:58:20 [ayvens.be] INFO: Extracting data for car ID: 1980571
2026-03-24 22:58:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1980571
2026-03-24 22:58:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc62ded9-a378-5b04-aa3f-1ff811f2e715 with scrape type 1
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/1.jpg not downloaded yet
2026-03-24 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/2.jpg not downloaded yet
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/3.jpg not downloaded yet
2026-03-24 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/4.jpg not downloaded yet
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836af50>
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/1.jpg saved to cache
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/5.jpg not downloaded yet
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008313d50>
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/3.jpg saved to cache
2026-03-24 22:58:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb2050>
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/2.jpg saved to cache
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/6.jpg not downloaded yet
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2a9d0>
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/8.jpg saved to cache
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911fcd0>
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/9.jpg saved to cache
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009396090>
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F833bee4f2cff4d2195c01ccb8153f749%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/10.jpg saved to cache
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 475ee9c4-092b-5843-b6ad-2aa8911b972e
2026-03-24 22:58:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 475ee9c4-092b-5843-b6ad-2aa8911b972e, skipping ID generation
2026-03-24 22:58:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 475ee9c4-092b-5843-b6ad-2aa8911b972e with scrape type 1
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 475ee9c4-092b-5843-b6ad-2aa8911b972e sending to next pipeline
2026-03-24 22:58:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 475ee9c4-092b-5843-b6ad-2aa8911b972e, identifier: 1980569
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aecfcd0>
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/5.jpg saved to cache
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083be790>
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/4.jpg saved to cache
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4fd0>
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/6.jpg saved to cache
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/7.jpg not downloaded yet
2026-03-24 22:58:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 475ee9c4-092b-5843-b6ad-2aa8911b972e with identifier: 1980569
2026-03-24 22:58:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 475ee9c4-092b-5843-b6ad-2aa8911b972e with identifier: 1980569
2026-03-24 22:58:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 475ee9c4-092b-5843-b6ad-2aa8911b972e with identifier: 1980569 to the API
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '475ee9c4-092b-5843-b6ad-2aa8911b972e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 158208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_475ee9c4-092b-5843-b6ad-2aa8911b972e/475ee9c4-092b-5843-b6ad-2aa8911b972e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/833bee4f2cff4d2195c01ccb8153f749/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 316D (90KW) TOURING',
 'transmission': 'manual',
 'trim': '2.0 316D (90KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980569%27 HTTP/1.1" 200 None
2026-03-24 22:58:22 [ayvens.be] INFO: Saving data for 1980569: {'created_time': 1774393102.060555, 'last_price_update_time': 1774393102.060565, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980569') HTTP/1.1" 204 0
2026-03-24 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/8.jpg not downloaded yet
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564310>
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/7.jpg saved to cache
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009122950>
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/8.jpg saved to cache
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d4d50>
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/10.jpg saved to cache
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/9.jpg not downloaded yet
2026-03-24 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/10.jpg not downloaded yet
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b7350>
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/1.jpg saved to cache
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564c10>
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/2.jpg saved to cache
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971ba90>
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F07091fc4f2084274b137746e111a3ab0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/9.jpg saved to cache
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f59e1dc1-9407-5451-af2c-f810e89334ef
2026-03-24 22:58:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f59e1dc1-9407-5451-af2c-f810e89334ef, skipping ID generation
2026-03-24 22:58:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59e1dc1-9407-5451-af2c-f810e89334ef with scrape type 1
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f59e1dc1-9407-5451-af2c-f810e89334ef sending to next pipeline
2026-03-24 22:58:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f59e1dc1-9407-5451-af2c-f810e89334ef, identifier: 1980570
2026-03-24 22:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:22 [ayvens.be] INFO: Found listing with ID: 1980572
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980572%27 HTTP/1.1" 200 None
2026-03-24 22:58:22 [ayvens.be] INFO: Scrape type for 1980572: 1
2026-03-24 22:58:22 [ayvens.be] INFO: Extracting data for car ID: 1980572
2026-03-24 22:58:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1980572
2026-03-24 22:58:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68726777-665d-5bfe-8065-2c689b768477 with scrape type 1
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/1.jpg not downloaded yet
2026-03-24 22:58:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1980570
2026-03-24 22:58:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1980570
2026-03-24 22:58:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f59e1dc1-9407-5451-af2c-f810e89334ef with identifier: 1980570 to the API
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f59e1dc1-9407-5451-af2c-f810e89334ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 44031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59e1dc1-9407-5451-af2c-f810e89334ef/f59e1dc1-9407-5451-af2c-f810e89334ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/07091fc4f2084274b137746e111a3ab0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980570%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [ayvens.be] INFO: Saving data for 1980570: {'created_time': 1774393103.093876, 'last_price_update_time': 1774393103.093886, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980570') HTTP/1.1" 204 0
2026-03-24 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/2.jpg not downloaded yet
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b8c10>
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/3.jpg saved to cache
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00900ab50>
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/4.jpg saved to cache
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009395090>
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/6.jpg saved to cache
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/3.jpg not downloaded yet
2026-03-24 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/4.jpg not downloaded yet
2026-03-24 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009121490>
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/5.jpg saved to cache
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/5.jpg not downloaded yet
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/6.jpg not downloaded yet
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/7.jpg not downloaded yet
2026-03-24 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1c0150>
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/7.jpg saved to cache
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cda90>
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/8.jpg saved to cache
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/8.jpg not downloaded yet
2026-03-24 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a24d0>
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/9.jpg saved to cache
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/9.jpg not downloaded yet
2026-03-24 22:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a2e50>
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F31238dcafb7240eda95e18f06fdd922f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/10.jpg saved to cache
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc62ded9-a378-5b04-aa3f-1ff811f2e715
2026-03-24 22:58:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc62ded9-a378-5b04-aa3f-1ff811f2e715, skipping ID generation
2026-03-24 22:58:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc62ded9-a378-5b04-aa3f-1ff811f2e715 with scrape type 1
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc62ded9-a378-5b04-aa3f-1ff811f2e715 sending to next pipeline
2026-03-24 22:58:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc62ded9-a378-5b04-aa3f-1ff811f2e715, identifier: 1980571
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/10.jpg not downloaded yet
2026-03-24 22:58:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1980571
2026-03-24 22:58:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1980571
2026-03-24 22:58:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc62ded9-a378-5b04-aa3f-1ff811f2e715 with identifier: 1980571 to the API
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bc62ded9-a378-5b04-aa3f-1ff811f2e715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 148610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc62ded9-a378-5b04-aa3f-1ff811f2e715/bc62ded9-a378-5b04-aa3f-1ff811f2e715_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/31238dcafb7240eda95e18f06fdd922f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 PHEV 225 BASTILLE + AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 BASTILLE + AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980571%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [ayvens.be] INFO: Saving data for 1980571: {'created_time': 1774393104.280299, 'last_price_update_time': 1774393104.280308, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980571') HTTP/1.1" 204 0
2026-03-24 22:58:24 [ayvens.be] INFO: Found listing with ID: 1980573
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980573%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [ayvens.be] INFO: Scrape type for 1980573: 1
2026-03-24 22:58:24 [ayvens.be] INFO: Extracting data for car ID: 1980573
2026-03-24 22:58:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61edf60d-253b-5f21-a6f3-9c22315f77a7 with identifier: 1980573
2026-03-24 22:58:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61edf60d-253b-5f21-a6f3-9c22315f77a7 with scrape type 1
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/1.jpg not downloaded yet
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338490>
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/1.jpg saved to cache
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b94d0>
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/2.jpg saved to cache
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/2.jpg not downloaded yet
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/3.jpg not downloaded yet
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/4.jpg not downloaded yet
2026-03-24 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/5.jpg not downloaded yet
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/6.jpg not downloaded yet
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/7.jpg not downloaded yet
2026-03-24 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/8.jpg not downloaded yet
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/9.jpg not downloaded yet
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095edb10>
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/5.jpg saved to cache
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d8110>
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/4.jpg saved to cache
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a1b90>
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/3.jpg saved to cache
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/10.jpg not downloaded yet
2026-03-24 22:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:25 [ayvens.be] INFO: Found listing with ID: 1980574
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980574%27 HTTP/1.1" 200 None
2026-03-24 22:58:25 [ayvens.be] INFO: Scrape type for 1980574: 1
2026-03-24 22:58:25 [ayvens.be] INFO: Extracting data for car ID: 1980574
2026-03-24 22:58:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with identifier: 1980574
2026-03-24 22:58:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with scrape type 1
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/1.jpg not downloaded yet
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/2.jpg not downloaded yet
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00835ae10>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/6.jpg saved to cache
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913fa50>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/7.jpg saved to cache
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f9d50>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/9.jpg saved to cache
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d02d50>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/8.jpg saved to cache
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/3.jpg not downloaded yet
2026-03-24 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/4.jpg not downloaded yet
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094aa110>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/1.jpg saved to cache
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/5.jpg not downloaded yet
2026-03-24 22:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a2890>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7364e7467f7f458f9bf1d74ebb45d6af%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/10.jpg saved to cache
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68726777-665d-5bfe-8065-2c689b768477
2026-03-24 22:58:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68726777-665d-5bfe-8065-2c689b768477, skipping ID generation
2026-03-24 22:58:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68726777-665d-5bfe-8065-2c689b768477 with scrape type 1
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68726777-665d-5bfe-8065-2c689b768477 sending to next pipeline
2026-03-24 22:58:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 68726777-665d-5bfe-8065-2c689b768477, identifier: 1980572
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d97590>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/6.jpg saved to cache
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962de90>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/4.jpg saved to cache
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a0050>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/5.jpg saved to cache
2026-03-24 22:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d0950>
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/3.jpg saved to cache
2026-03-24 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369e50>
2026-03-24 22:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/2.jpg saved to cache
2026-03-24 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/6.jpg not downloaded yet
2026-03-24 22:58:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1980572
2026-03-24 22:58:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1980572
2026-03-24 22:58:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 68726777-665d-5bfe-8065-2c689b768477 with identifier: 1980572 to the API
2026-03-24 22:58:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '68726777-665d-5bfe-8065-2c689b768477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 112884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68726777-665d-5bfe-8065-2c689b768477/68726777-665d-5bfe-8065-2c689b768477_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7364e7467f7f458f9bf1d74ebb45d6af/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON 1.4 EHYBRID DSG R-LINE',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID DSG R-LINE',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980572%27 HTTP/1.1" 200 None
2026-03-24 22:58:27 [ayvens.be] INFO: Saving data for 1980572: {'created_time': 1774393107.18023, 'last_price_update_time': 1774393107.180241, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980572') HTTP/1.1" 204 0
2026-03-24 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/7.jpg not downloaded yet
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916e5d0>
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/7.jpg saved to cache
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6cfcd0>
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/8.jpg saved to cache
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/8.jpg not downloaded yet
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009442450>
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/9.jpg saved to cache
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009157e10>
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fe372196cee09479daf2d7a0681ed7f26%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/10.jpg saved to cache
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61edf60d-253b-5f21-a6f3-9c22315f77a7
2026-03-24 22:58:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61edf60d-253b-5f21-a6f3-9c22315f77a7, skipping ID generation
2026-03-24 22:58:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61edf60d-253b-5f21-a6f3-9c22315f77a7 with scrape type 1
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61edf60d-253b-5f21-a6f3-9c22315f77a7 sending to next pipeline
2026-03-24 22:58:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 61edf60d-253b-5f21-a6f3-9c22315f77a7, identifier: 1980573
2026-03-24 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/9.jpg not downloaded yet
2026-03-24 22:58:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 61edf60d-253b-5f21-a6f3-9c22315f77a7 with identifier: 1980573
2026-03-24 22:58:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 61edf60d-253b-5f21-a6f3-9c22315f77a7 with identifier: 1980573
2026-03-24 22:58:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 61edf60d-253b-5f21-a6f3-9c22315f77a7 with identifier: 1980573 to the API
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '61edf60d-253b-5f21-a6f3-9c22315f77a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 88971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61edf60d-253b-5f21-a6f3-9c22315f77a7/61edf60d-253b-5f21-a6f3-9c22315f77a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/e372196cee09479daf2d7a0681ed7f26/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980573%27 HTTP/1.1" 200 None
2026-03-24 22:58:27 [ayvens.be] INFO: Saving data for 1980573: {'created_time': 1774393107.968083, 'last_price_update_time': 1774393107.968093, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980573') HTTP/1.1" 204 0
2026-03-24 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/10.jpg not downloaded yet
2026-03-24 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009839150>
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/3.jpg saved to cache
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:28 [ayvens.be] INFO: Found listing with ID: 1980575
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980575%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [ayvens.be] INFO: Scrape type for 1980575: 1
2026-03-24 22:58:28 [ayvens.be] INFO: Extracting data for car ID: 1980575
2026-03-24 22:58:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fddb233-cec4-5a57-8cac-332c509be68e with identifier: 1980575
2026-03-24 22:58:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fddb233-cec4-5a57-8cac-332c509be68e with scrape type 1
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/1.jpg not downloaded yet
2026-03-24 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/2.jpg not downloaded yet
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bfad0>
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/2.jpg saved to cache
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b62d0>
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/1.jpg saved to cache
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a28110>
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/5.jpg saved to cache
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008371ed0>
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/4.jpg saved to cache
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/3.jpg not downloaded yet
2026-03-24 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/4.jpg not downloaded yet
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b08d0>
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/6.jpg saved to cache
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009863b50>
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/7.jpg saved to cache
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/5.jpg not downloaded yet
2026-03-24 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/6.jpg not downloaded yet
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983af50>
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/8.jpg saved to cache
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/7.jpg not downloaded yet
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/8.jpg not downloaded yet
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009470750>
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/9.jpg saved to cache
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097624d0>
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F161e1fddfa744e06a113558060897752%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/10.jpg saved to cache
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7
2026-03-24 22:58:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 241b61b2-ea2e-57de-ae03-168bc4bf04b7, skipping ID generation
2026-03-24 22:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with scrape type 1
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 241b61b2-ea2e-57de-ae03-168bc4bf04b7 sending to next pipeline
2026-03-24 22:58:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 241b61b2-ea2e-57de-ae03-168bc4bf04b7, identifier: 1980574
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/9.jpg not downloaded yet
2026-03-24 22:58:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with identifier: 1980574
2026-03-24 22:58:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with identifier: 1980574
2026-03-24 22:58:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 241b61b2-ea2e-57de-ae03-168bc4bf04b7 with identifier: 1980574 to the API
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '241b61b2-ea2e-57de-ae03-168bc4bf04b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 93370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_241b61b2-ea2e-57de-ae03-168bc4bf04b7/241b61b2-ea2e-57de-ae03-168bc4bf04b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/161e1fddfa744e06a113558060897752/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980574%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [ayvens.be] INFO: Saving data for 1980574: {'created_time': 1774393109.521434, 'last_price_update_time': 1774393109.521443, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980574') HTTP/1.1" 204 0
2026-03-24 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/10.jpg not downloaded yet
2026-03-24 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:29 [ayvens.be] INFO: Found listing with ID: 1980576
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980576%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [ayvens.be] INFO: Scrape type for 1980576: 1
2026-03-24 22:58:29 [ayvens.be] INFO: Extracting data for car ID: 1980576
2026-03-24 22:58:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66e1293d-9f61-520b-b07a-18f721a8f455 with identifier: 1980576
2026-03-24 22:58:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66e1293d-9f61-520b-b07a-18f721a8f455 with scrape type 1
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/1.jpg not downloaded yet
2026-03-24 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/2.jpg not downloaded yet
2026-03-24 22:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/3.jpg not downloaded yet
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/4.jpg not downloaded yet
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/5.jpg not downloaded yet
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b46e50>
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/1.jpg saved to cache
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/6.jpg not downloaded yet
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009861dd0>
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/2.jpg saved to cache
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083868d0>
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/3.jpg saved to cache
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/7.jpg not downloaded yet
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946e990>
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/5.jpg saved to cache
2026-03-24 22:58:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097aa250>
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/4.jpg saved to cache
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4b50>
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/6.jpg saved to cache
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145190>
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/7.jpg saved to cache
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/8.jpg not downloaded yet
2026-03-24 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/9.jpg not downloaded yet
2026-03-24 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/10.jpg not downloaded yet
2026-03-24 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:30 [ayvens.be] INFO: Found listing with ID: 1980577
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980577%27 HTTP/1.1" 200 None
2026-03-24 22:58:30 [ayvens.be] INFO: Scrape type for 1980577: 1
2026-03-24 22:58:30 [ayvens.be] INFO: Extracting data for car ID: 1980577
2026-03-24 22:58:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: def2c99e-3f4a-58de-ac43-9de97793e71f with identifier: 1980577
2026-03-24 22:58:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def2c99e-3f4a-58de-ac43-9de97793e71f with scrape type 1
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/1.jpg not downloaded yet
2026-03-24 22:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/2.jpg not downloaded yet
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/3.jpg not downloaded yet
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d4fd0>
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/8.jpg saved to cache
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/4.jpg not downloaded yet
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bc790>
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/9.jpg saved to cache
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009156a90>
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F410257543ea64c2ca9c4935d9bcee9b1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/10.jpg saved to cache
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fddb233-cec4-5a57-8cac-332c509be68e
2026-03-24 22:58:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fddb233-cec4-5a57-8cac-332c509be68e, skipping ID generation
2026-03-24 22:58:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fddb233-cec4-5a57-8cac-332c509be68e with scrape type 1
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fddb233-cec4-5a57-8cac-332c509be68e sending to next pipeline
2026-03-24 22:58:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7fddb233-cec4-5a57-8cac-332c509be68e, identifier: 1980575
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/5.jpg not downloaded yet
2026-03-24 22:58:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7fddb233-cec4-5a57-8cac-332c509be68e with identifier: 1980575
2026-03-24 22:58:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7fddb233-cec4-5a57-8cac-332c509be68e with identifier: 1980575
2026-03-24 22:58:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7fddb233-cec4-5a57-8cac-332c509be68e with identifier: 1980575 to the API
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '7fddb233-cec4-5a57-8cac-332c509be68e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 78626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fddb233-cec4-5a57-8cac-332c509be68e/7fddb233-cec4-5a57-8cac-332c509be68e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/410257543ea64c2ca9c4935d9bcee9b1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980575%27 HTTP/1.1" 200 None
2026-03-24 22:58:31 [ayvens.be] INFO: Saving data for 1980575: {'created_time': 1774393111.134591, 'last_price_update_time': 1774393111.134602, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980575') HTTP/1.1" 204 0
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008316910>
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/1.jpg saved to cache
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317190>
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/3.jpg saved to cache
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009019c10>
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/5.jpg saved to cache
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008381490>
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/2.jpg saved to cache
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c2750>
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/4.jpg saved to cache
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/6.jpg not downloaded yet
2026-03-24 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/7.jpg not downloaded yet
2026-03-24 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/8.jpg not downloaded yet
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/9.jpg not downloaded yet
2026-03-24 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/10.jpg not downloaded yet
2026-03-24 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:31 [ayvens.be] INFO: Found listing with ID: 1980578
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980578%27 HTTP/1.1" 200 None
2026-03-24 22:58:31 [ayvens.be] INFO: Scrape type for 1980578: 1
2026-03-24 22:58:31 [ayvens.be] INFO: Extracting data for car ID: 1980578
2026-03-24 22:58:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1980578
2026-03-24 22:58:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d49266-b07d-5698-9e45-925e342cd487 with scrape type 1
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/1.jpg not downloaded yet
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760b90>
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/7.jpg saved to cache
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009565a50>
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/6.jpg saved to cache
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7ed0>
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/10.jpg saved to cache
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/2.jpg not downloaded yet
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946f890>
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/8.jpg saved to cache
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/3.jpg not downloaded yet
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a0a90>
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252Fa453e8db40274045a129edcdd90720c1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/9.jpg saved to cache
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66e1293d-9f61-520b-b07a-18f721a8f455
2026-03-24 22:58:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66e1293d-9f61-520b-b07a-18f721a8f455, skipping ID generation
2026-03-24 22:58:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66e1293d-9f61-520b-b07a-18f721a8f455 with scrape type 1
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66e1293d-9f61-520b-b07a-18f721a8f455 sending to next pipeline
2026-03-24 22:58:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 66e1293d-9f61-520b-b07a-18f721a8f455, identifier: 1980576
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeacc50>
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/1.jpg saved to cache
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564850>
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/2.jpg saved to cache
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449dd0>
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/3.jpg saved to cache
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 66e1293d-9f61-520b-b07a-18f721a8f455 with identifier: 1980576
2026-03-24 22:58:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 66e1293d-9f61-520b-b07a-18f721a8f455 with identifier: 1980576
2026-03-24 22:58:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 66e1293d-9f61-520b-b07a-18f721a8f455 with identifier: 1980576 to the API
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '66e1293d-9f61-520b-b07a-18f721a8f455',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3-serie',
 'odometer': 128346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66e1293d-9f61-520b-b07a-18f721a8f455/66e1293d-9f61-520b-b07a-18f721a8f455_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/a453e8db40274045a129edcdd90720c1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3-serie 2.0 318D (100KW) TOURING',
 'transmission': 'manual',
 'trim': '2.0 318D (100KW) TOURING',
 'vin': None,
 'year': 2020}
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980576%27 HTTP/1.1" 200 None
2026-03-24 22:58:32 [ayvens.be] INFO: Saving data for 1980576: {'created_time': 1774393112.738064, 'last_price_update_time': 1774393112.738073, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980576') HTTP/1.1" 204 0
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/4.jpg not downloaded yet
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/5.jpg not downloaded yet
2026-03-24 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/6.jpg not downloaded yet
2026-03-24 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/7.jpg not downloaded yet
2026-03-24 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/8.jpg not downloaded yet
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/9.jpg not downloaded yet
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/10.jpg not downloaded yet
2026-03-24 22:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b7fd0>
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/4.jpg saved to cache
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a2ed0>
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/5.jpg saved to cache
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:33 [ayvens.be] INFO: Found listing with ID: 1980579
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980579%27 HTTP/1.1" 200 None
2026-03-24 22:58:33 [ayvens.be] INFO: Scrape type for 1980579: 1
2026-03-24 22:58:33 [ayvens.be] INFO: Extracting data for car ID: 1980579
2026-03-24 22:58:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed77adca-f00b-5d88-b37c-f5b42649bc36 with identifier: 1980579
2026-03-24 22:58:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed77adca-f00b-5d88-b37c-f5b42649bc36 with scrape type 1
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/1.jpg not downloaded yet
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009639f50>
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/7.jpg saved to cache
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009702510>
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/1.jpg saved to cache
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/2.jpg not downloaded yet
2026-03-24 22:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff018b61290>
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/6.jpg saved to cache
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4d50>
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/10.jpg saved to cache
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091779d0>
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/9.jpg saved to cache
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f9110>
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252Ff67e72c1b81e45c0aeff4cff13de5896%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/8.jpg saved to cache
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item def2c99e-3f4a-58de-ac43-9de97793e71f
2026-03-24 22:58:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: def2c99e-3f4a-58de-ac43-9de97793e71f, skipping ID generation
2026-03-24 22:58:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def2c99e-3f4a-58de-ac43-9de97793e71f with scrape type 1
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item def2c99e-3f4a-58de-ac43-9de97793e71f sending to next pipeline
2026-03-24 22:58:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: def2c99e-3f4a-58de-ac43-9de97793e71f, identifier: 1980577
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009666fd0>
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/3.jpg saved to cache
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/3.jpg not downloaded yet
2026-03-24 22:58:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: def2c99e-3f4a-58de-ac43-9de97793e71f with identifier: 1980577
2026-03-24 22:58:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: def2c99e-3f4a-58de-ac43-9de97793e71f with identifier: 1980577
2026-03-24 22:58:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: def2c99e-3f4a-58de-ac43-9de97793e71f with identifier: 1980577 to the API
2026-03-24 22:58:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'def2c99e-3f4a-58de-ac43-9de97793e71f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 42279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_def2c99e-3f4a-58de-ac43-9de97793e71f/def2c99e-3f4a-58de-ac43-9de97793e71f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/f67e72c1b81e45c0aeff4cff13de5896/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980577%27 HTTP/1.1" 200 None
2026-03-24 22:58:34 [ayvens.be] INFO: Saving data for 1980577: {'created_time': 1774393114.186719, 'last_price_update_time': 1774393114.186728, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980577') HTTP/1.1" 204 0
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/4.jpg not downloaded yet
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c990>
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/2.jpg saved to cache
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083084d0>
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/6.jpg saved to cache
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/5.jpg not downloaded yet
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/6.jpg not downloaded yet
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b2850>
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/5.jpg saved to cache
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008317a50>
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/4.jpg saved to cache
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/7.jpg not downloaded yet
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e0f10>
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/7.jpg saved to cache
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/8.jpg not downloaded yet
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/9.jpg not downloaded yet
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/10.jpg not downloaded yet
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978af90>
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/8.jpg saved to cache
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c9d0>
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/10.jpg saved to cache
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b45290>
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/1.jpg saved to cache
2026-03-24 22:58:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d4610>
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0d7069915d5046779634c6b6278abf70%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/9.jpg saved to cache
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25d49266-b07d-5698-9e45-925e342cd487
2026-03-24 22:58:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25d49266-b07d-5698-9e45-925e342cd487, skipping ID generation
2026-03-24 22:58:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d49266-b07d-5698-9e45-925e342cd487 with scrape type 1
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25d49266-b07d-5698-9e45-925e342cd487 sending to next pipeline
2026-03-24 22:58:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 25d49266-b07d-5698-9e45-925e342cd487, identifier: 1980578
2026-03-24 22:58:35 [ayvens.be] INFO: Found listing with ID: 1980580
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980580%27 HTTP/1.1" 200 None
2026-03-24 22:58:35 [ayvens.be] INFO: Scrape type for 1980580: 1
2026-03-24 22:58:35 [ayvens.be] INFO: Extracting data for car ID: 1980580
2026-03-24 22:58:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86266e6c-be0f-5870-a58f-16ec6650520e with identifier: 1980580
2026-03-24 22:58:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86266e6c-be0f-5870-a58f-16ec6650520e with scrape type 1
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/1.jpg not downloaded yet
2026-03-24 22:58:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1980578
2026-03-24 22:58:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1980578
2026-03-24 22:58:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 25d49266-b07d-5698-9e45-925e342cd487 with identifier: 1980578 to the API
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '25d49266-b07d-5698-9e45-925e342cd487',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 152141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d49266-b07d-5698-9e45-925e342cd487/25d49266-b07d-5698-9e45-925e342cd487_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0d7069915d5046779634c6b6278abf70/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2020}
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980578%27 HTTP/1.1" 200 None
2026-03-24 22:58:35 [ayvens.be] INFO: Saving data for 1980578: {'created_time': 1774393115.531215, 'last_price_update_time': 1774393115.531224, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980578') HTTP/1.1" 204 0
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/2.jpg not downloaded yet
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b44990>
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/2.jpg saved to cache
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cf250>
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/3.jpg saved to cache
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083374d0>
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/4.jpg saved to cache
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009641790>
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/5.jpg saved to cache
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/3.jpg not downloaded yet
2026-03-24 22:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/4.jpg not downloaded yet
2026-03-24 22:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/5.jpg not downloaded yet
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/6.jpg not downloaded yet
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/7.jpg not downloaded yet
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/8.jpg not downloaded yet
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/9.jpg not downloaded yet
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/10.jpg not downloaded yet
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2ea90>
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/7.jpg saved to cache
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009643e90>
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/6.jpg saved to cache
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009448790>
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/8.jpg saved to cache
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6f90>
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/9.jpg saved to cache
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:36 [ayvens.be] INFO: Found listing with ID: 1980581
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980581%27 HTTP/1.1" 200 None
2026-03-24 22:58:36 [ayvens.be] INFO: Scrape type for 1980581: 1
2026-03-24 22:58:36 [ayvens.be] INFO: Extracting data for car ID: 1980581
2026-03-24 22:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1980581
2026-03-24 22:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac99e38-7861-5476-8a42-9368ec6b38bb with scrape type 1
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/1.jpg not downloaded yet
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009614d10>
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fb636b8d83517420db3ea50666ed078d6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/10.jpg saved to cache
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed77adca-f00b-5d88-b37c-f5b42649bc36
2026-03-24 22:58:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed77adca-f00b-5d88-b37c-f5b42649bc36, skipping ID generation
2026-03-24 22:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed77adca-f00b-5d88-b37c-f5b42649bc36 with scrape type 1
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed77adca-f00b-5d88-b37c-f5b42649bc36 sending to next pipeline
2026-03-24 22:58:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ed77adca-f00b-5d88-b37c-f5b42649bc36, identifier: 1980579
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/2.jpg not downloaded yet
2026-03-24 22:58:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ed77adca-f00b-5d88-b37c-f5b42649bc36 with identifier: 1980579
2026-03-24 22:58:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ed77adca-f00b-5d88-b37c-f5b42649bc36 with identifier: 1980579
2026-03-24 22:58:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ed77adca-f00b-5d88-b37c-f5b42649bc36 with identifier: 1980579 to the API
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ed77adca-f00b-5d88-b37c-f5b42649bc36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 14625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77adca-f00b-5d88-b37c-f5b42649bc36/ed77adca-f00b-5d88-b37c-f5b42649bc36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/b636b8d83517420db3ea50666ed078d6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216I ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216I ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980579%27 HTTP/1.1" 200 None
2026-03-24 22:58:36 [ayvens.be] INFO: Saving data for 1980579: {'created_time': 1774393116.920902, 'last_price_update_time': 1774393116.920914, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980579') HTTP/1.1" 204 0
2026-03-24 22:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/3.jpg not downloaded yet
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/4.jpg not downloaded yet
2026-03-24 22:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/5.jpg not downloaded yet
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/6.jpg not downloaded yet
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/7.jpg not downloaded yet
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/8.jpg not downloaded yet
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/9.jpg not downloaded yet
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369310>
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/1.jpg saved to cache
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/10.jpg not downloaded yet
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [ayvens.be] INFO: Found listing with ID: 1980582
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980582%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [ayvens.be] INFO: Scrape type for 1980582: 1
2026-03-24 22:58:37 [ayvens.be] INFO: Extracting data for car ID: 1980582
2026-03-24 22:58:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4fa3408-e3e8-55cc-b86e-75a5f485d388 with identifier: 1980582
2026-03-24 22:58:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4fa3408-e3e8-55cc-b86e-75a5f485d388 with scrape type 1
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/1.jpg not downloaded yet
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/2.jpg not downloaded yet
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083854d0>
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/2.jpg saved to cache
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091324d0>
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/5.jpg saved to cache
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00912a410>
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/3.jpg saved to cache
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfcd50>
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/6.jpg saved to cache
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009133990>
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/7.jpg saved to cache
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a6f90>
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/8.jpg saved to cache
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008383550>
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/4.jpg saved to cache
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/3.jpg not downloaded yet
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009186f50>
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/9.jpg saved to cache
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/4.jpg not downloaded yet
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/5.jpg not downloaded yet
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/6.jpg not downloaded yet
2026-03-24 22:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/7.jpg not downloaded yet
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/8.jpg not downloaded yet
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/9.jpg not downloaded yet
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/10.jpg not downloaded yet
2026-03-24 22:58:38 [ayvens.be] INFO: Found listing with ID: 1980583
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980583%27 HTTP/1.1" 200 None
2026-03-24 22:58:38 [ayvens.be] INFO: Scrape type for 1980583: 1
2026-03-24 22:58:38 [ayvens.be] INFO: Extracting data for car ID: 1980583
2026-03-24 22:58:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with identifier: 1980583
2026-03-24 22:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with scrape type 1
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/1.jpg not downloaded yet
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4110>
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/3.jpg saved to cache
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083087d0>
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/1.jpg saved to cache
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/2.jpg not downloaded yet
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913c650>
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/4.jpg saved to cache
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f090>
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb4f19438f02a415f9d3cef5f12a446c3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/10.jpg saved to cache
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86266e6c-be0f-5870-a58f-16ec6650520e
2026-03-24 22:58:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86266e6c-be0f-5870-a58f-16ec6650520e, skipping ID generation
2026-03-24 22:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86266e6c-be0f-5870-a58f-16ec6650520e with scrape type 1
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86266e6c-be0f-5870-a58f-16ec6650520e sending to next pipeline
2026-03-24 22:58:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86266e6c-be0f-5870-a58f-16ec6650520e, identifier: 1980580
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6e0390>
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/2.jpg saved to cache
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/3.jpg not downloaded yet
2026-03-24 22:58:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86266e6c-be0f-5870-a58f-16ec6650520e with identifier: 1980580
2026-03-24 22:58:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86266e6c-be0f-5870-a58f-16ec6650520e with identifier: 1980580
2026-03-24 22:58:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86266e6c-be0f-5870-a58f-16ec6650520e with identifier: 1980580 to the API
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '86266e6c-be0f-5870-a58f-16ec6650520e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 80193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86266e6c-be0f-5870-a58f-16ec6650520e/86266e6c-be0f-5870-a58f-16ec6650520e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b4f19438f02a415f9d3cef5f12a446c3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980580%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [ayvens.be] INFO: Saving data for 1980580: {'created_time': 1774393119.046217, 'last_price_update_time': 1774393119.046227, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980580') HTTP/1.1" 204 0
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/4.jpg not downloaded yet
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/5.jpg not downloaded yet
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/6.jpg not downloaded yet
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/7.jpg not downloaded yet
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/8.jpg not downloaded yet
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/9.jpg not downloaded yet
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091f53d0>
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/2.jpg saved to cache
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7710>
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/3.jpg saved to cache
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/10.jpg not downloaded yet
2026-03-24 22:58:39 [ayvens.be] INFO: Found listing with ID: 1980584
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980584%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [ayvens.be] INFO: Scrape type for 1980584: 1
2026-03-24 22:58:39 [ayvens.be] INFO: Extracting data for car ID: 1980584
2026-03-24 22:58:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1980584
2026-03-24 22:58:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0360f333-f9a9-58e4-b8ab-91c3bc796021 with scrape type 1
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/1.jpg not downloaded yet
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/2.jpg not downloaded yet
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008d038d0>
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/9.jpg saved to cache
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b47290>
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/1.jpg saved to cache
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b2a10>
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/6.jpg saved to cache
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009943810>
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/10.jpg saved to cache
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cf9d0>
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/7.jpg saved to cache
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335ad0>
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/8.jpg saved to cache
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/3.jpg not downloaded yet
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/4.jpg not downloaded yet
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/5.jpg not downloaded yet
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/6.jpg not downloaded yet
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/7.jpg not downloaded yet
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/8.jpg not downloaded yet
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/9.jpg not downloaded yet
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/10.jpg not downloaded yet
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009762e50>
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/5.jpg saved to cache
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788990>
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/4.jpg saved to cache
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:40 [ayvens.be] INFO: Found listing with ID: 1980585
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980585%27 HTTP/1.1" 200 None
2026-03-24 22:58:40 [ayvens.be] INFO: Scrape type for 1980585: 1
2026-03-24 22:58:40 [ayvens.be] INFO: Extracting data for car ID: 1980585
2026-03-24 22:58:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1980585
2026-03-24 22:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d550fb4-a647-5a1b-8837-81f98eace162 with scrape type 1
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/1.jpg not downloaded yet
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098608d0>
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F8d0b0a9cb78b49b7a2665f6121ebd9bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/5.jpg saved to cache
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aac99e38-7861-5476-8a42-9368ec6b38bb
2026-03-24 22:58:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aac99e38-7861-5476-8a42-9368ec6b38bb, skipping ID generation
2026-03-24 22:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac99e38-7861-5476-8a42-9368ec6b38bb with scrape type 1
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aac99e38-7861-5476-8a42-9368ec6b38bb sending to next pipeline
2026-03-24 22:58:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aac99e38-7861-5476-8a42-9368ec6b38bb, identifier: 1980581
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aecfc10>
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/10.jpg saved to cache
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1ba750>
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/6.jpg saved to cache
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2b490>
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/8.jpg saved to cache
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/2.jpg not downloaded yet
2026-03-24 22:58:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1980581
2026-03-24 22:58:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1980581
2026-03-24 22:58:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aac99e38-7861-5476-8a42-9368ec6b38bb with identifier: 1980581 to the API
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aac99e38-7861-5476-8a42-9368ec6b38bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 66887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 866888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac99e38-7861-5476-8a42-9368ec6b38bb/aac99e38-7861-5476-8a42-9368ec6b38bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/8d0b0a9cb78b49b7a2665f6121ebd9bb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 520D 120KW TOURING AUTO',
 'transmission': 'automatic',
 'trim': '2.0 520D 120KW TOURING AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980581%27 HTTP/1.1" 200 None
2026-03-24 22:58:41 [ayvens.be] INFO: Saving data for 1980581: {'created_time': 1774393121.029916, 'last_price_update_time': 1774393121.029925, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980581') HTTP/1.1" 204 0
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/3.jpg not downloaded yet
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a29050>
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/7.jpg saved to cache
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb3b90>
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ffaccea63f2ed4089b659a6418c4d8274%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/9.jpg saved to cache
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4fa3408-e3e8-55cc-b86e-75a5f485d388
2026-03-24 22:58:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4fa3408-e3e8-55cc-b86e-75a5f485d388, skipping ID generation
2026-03-24 22:58:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4fa3408-e3e8-55cc-b86e-75a5f485d388 with scrape type 1
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4fa3408-e3e8-55cc-b86e-75a5f485d388 sending to next pipeline
2026-03-24 22:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a4fa3408-e3e8-55cc-b86e-75a5f485d388, identifier: 1980582
2026-03-24 22:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a4fa3408-e3e8-55cc-b86e-75a5f485d388 with identifier: 1980582
2026-03-24 22:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a4fa3408-e3e8-55cc-b86e-75a5f485d388 with identifier: 1980582
2026-03-24 22:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a4fa3408-e3e8-55cc-b86e-75a5f485d388 with identifier: 1980582 to the API
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a4fa3408-e3e8-55cc-b86e-75a5f485d388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLE DIESEL (W167)',
 'odometer': 100626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4fa3408-e3e8-55cc-b86e-75a5f485d388/a4fa3408-e3e8-55cc-b86e-75a5f485d388_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/faccea63f2ed4089b659a6418c4d8274/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLE DIESEL (W167) GLE 350 de 4-Ma PHEV Business '
          'Solution',
 'transmission': 'automatic',
 'trim': 'GLE 350 de 4-Ma PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980582%27 HTTP/1.1" 200 None
2026-03-24 22:58:41 [ayvens.be] INFO: Saving data for 1980582: {'created_time': 1774393121.739472, 'last_price_update_time': 1774393121.739483, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980582') HTTP/1.1" 204 0
2026-03-24 22:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/4.jpg not downloaded yet
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095e0ad0>
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/3.jpg saved to cache
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/5.jpg not downloaded yet
2026-03-24 22:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959cd50>
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/1.jpg saved to cache
2026-03-24 22:58:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009146090>
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/2.jpg saved to cache
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959cd50>
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/5.jpg saved to cache
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/6.jpg not downloaded yet
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/7.jpg not downloaded yet
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009130bd0>
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/10.jpg saved to cache
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083380d0>
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/4.jpg saved to cache
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971a050>
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/9.jpg saved to cache
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/8.jpg not downloaded yet
2026-03-24 22:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/9.jpg not downloaded yet
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0095c7710>
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/6.jpg saved to cache
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098b76d0>
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/3.jpg saved to cache
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/10.jpg not downloaded yet
2026-03-24 22:58:42 [ayvens.be] INFO: Found listing with ID: 1980586
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980586%27 HTTP/1.1" 200 None
2026-03-24 22:58:42 [ayvens.be] INFO: Scrape type for 1980586: 1
2026-03-24 22:58:42 [ayvens.be] INFO: Extracting data for car ID: 1980586
2026-03-24 22:58:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1980586
2026-03-24 22:58:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572fb211-c34a-540b-b492-e638d580713e with scrape type 1
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/1.jpg not downloaded yet
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/2.jpg not downloaded yet
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009861e10>
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/2.jpg saved to cache
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d4d50>
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/4.jpg saved to cache
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091b7090>
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/1.jpg saved to cache
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/3.jpg not downloaded yet
2026-03-24 22:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b1550>
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/9.jpg saved to cache
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009458410>
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/10.jpg saved to cache
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/4.jpg not downloaded yet
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/5.jpg not downloaded yet
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009838d10>
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/7.jpg saved to cache
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959d010>
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2am%252Fd22ab3eedbe94049b0fe48433ecff971%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/8.jpg saved to cache
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1
2026-03-24 22:58:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b38844c-bcca-5b09-a0a3-8a407706a5e1, skipping ID generation
2026-03-24 22:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with scrape type 1
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b38844c-bcca-5b09-a0a3-8a407706a5e1 sending to next pipeline
2026-03-24 22:58:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7b38844c-bcca-5b09-a0a3-8a407706a5e1, identifier: 1980583
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008343750>
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/1.jpg saved to cache
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915d5d0>
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/8.jpg saved to cache
2026-03-24 22:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with identifier: 1980583
2026-03-24 22:58:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with identifier: 1980583
2026-03-24 22:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7b38844c-bcca-5b09-a0a3-8a407706a5e1 with identifier: 1980583 to the API
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b38844c-bcca-5b09-a0a3-8a407706a5e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 86144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b38844c-bcca-5b09-a0a3-8a407706a5e1/7b38844c-bcca-5b09-a0a3-8a407706a5e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2am/d22ab3eedbe94049b0fe48433ecff971/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'transmission': 'automatic',
 'trim': '2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980583%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [ayvens.be] INFO: Saving data for 1980583: {'created_time': 1774393124.279644, 'last_price_update_time': 1774393124.279654, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980583') HTTP/1.1" 204 0
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/6.jpg not downloaded yet
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/7.jpg not downloaded yet
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc55d0>
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/3.jpg saved to cache
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945a2d0>
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/2.jpg saved to cache
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/8.jpg not downloaded yet
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/9.jpg not downloaded yet
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bc850>
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/5.jpg saved to cache
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009008d10>
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/6.jpg saved to cache
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910c3d0>
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/7.jpg saved to cache
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098bd610>
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/6.jpg saved to cache
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/10.jpg not downloaded yet
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [ayvens.be] INFO: Found listing with ID: 1980587
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980587%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [ayvens.be] INFO: Scrape type for 1980587: 1
2026-03-24 22:58:44 [ayvens.be] INFO: Extracting data for car ID: 1980587
2026-03-24 22:58:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1980587
2026-03-24 22:58:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f18e9342-4f12-553c-b02c-5645e403a20a with scrape type 1
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/1.jpg not downloaded yet
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/2.jpg not downloaded yet
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/3.jpg not downloaded yet
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/4.jpg not downloaded yet
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097aa090>
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/4.jpg saved to cache
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/5.jpg not downloaded yet
2026-03-24 22:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab010>
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dq%252F6e65baf907344d4cbea47bd131d7b0dc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/5.jpg saved to cache
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0360f333-f9a9-58e4-b8ab-91c3bc796021
2026-03-24 22:58:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0360f333-f9a9-58e4-b8ab-91c3bc796021, skipping ID generation
2026-03-24 22:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0360f333-f9a9-58e4-b8ab-91c3bc796021 with scrape type 1
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0360f333-f9a9-58e4-b8ab-91c3bc796021 sending to next pipeline
2026-03-24 22:58:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0360f333-f9a9-58e4-b8ab-91c3bc796021, identifier: 1980584
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae710>
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/7.jpg saved to cache
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/6.jpg not downloaded yet
2026-03-24 22:58:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1980584
2026-03-24 22:58:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1980584
2026-03-24 22:58:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0360f333-f9a9-58e4-b8ab-91c3bc796021 with identifier: 1980584 to the API
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '0360f333-f9a9-58e4-b8ab-91c3bc796021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPAu2030',
 'odometer': 77791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0360f333-f9a9-58e4-b8ab-91c3bc796021/0360f333-f9a9-58e4-b8ab-91c3bc796021_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dq/6e65baf907344d4cbea47bd131d7b0dc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPAu2030 1.5 218IA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 218IA GRAN COUPE',
 'vin': None,
 'year': 2023}
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980584%27 HTTP/1.1" 200 None
2026-03-24 22:58:45 [ayvens.be] INFO: Saving data for 1980584: {'created_time': 1774393125.620602, 'last_price_update_time': 1774393125.620612, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980584') HTTP/1.1" 204 0
2026-03-24 22:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/7.jpg not downloaded yet
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098b7e10>
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/1.jpg saved to cache
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4950>
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/2.jpg saved to cache
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009611b10>
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/10.jpg saved to cache
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c4510>
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/9.jpg saved to cache
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c78d0>
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/4.jpg saved to cache
2026-03-24 22:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009128a50>
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F0eb67494ef4e4fb49b348a309002a06e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/8.jpg saved to cache
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d550fb4-a647-5a1b-8837-81f98eace162
2026-03-24 22:58:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d550fb4-a647-5a1b-8837-81f98eace162, skipping ID generation
2026-03-24 22:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d550fb4-a647-5a1b-8837-81f98eace162 with scrape type 1
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d550fb4-a647-5a1b-8837-81f98eace162 sending to next pipeline
2026-03-24 22:58:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5d550fb4-a647-5a1b-8837-81f98eace162, identifier: 1980585
2026-03-24 22:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1980585
2026-03-24 22:58:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1980585
2026-03-24 22:58:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5d550fb4-a647-5a1b-8837-81f98eace162 with identifier: 1980585 to the API
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '5d550fb4-a647-5a1b-8837-81f98eace162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 74198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d550fb4-a647-5a1b-8837-81f98eace162/5d550fb4-a647-5a1b-8837-81f98eace162_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/0eb67494ef4e4fb49b348a309002a06e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980585%27 HTTP/1.1" 200 None
2026-03-24 22:58:46 [ayvens.be] INFO: Saving data for 1980585: {'created_time': 1774393126.522793, 'last_price_update_time': 1774393126.522803, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980585') HTTP/1.1" 204 0
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/8.jpg not downloaded yet
2026-03-24 22:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/9.jpg not downloaded yet
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094cf510>
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/5.jpg saved to cache
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae150>
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/6.jpg saved to cache
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009129e50>
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/7.jpg saved to cache
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bcad0>
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/3.jpg saved to cache
2026-03-24 22:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914c650>
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/8.jpg saved to cache
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/10.jpg not downloaded yet
2026-03-24 22:58:47 [ayvens.be] INFO: Found listing with ID: 1980588
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980588%27 HTTP/1.1" 200 None
2026-03-24 22:58:47 [ayvens.be] INFO: Scrape type for 1980588: 1
2026-03-24 22:58:47 [ayvens.be] INFO: Extracting data for car ID: 1980588
2026-03-24 22:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1980588
2026-03-24 22:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with scrape type 1
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/1.jpg not downloaded yet
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb0dd0>
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/10.jpg saved to cache
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a1250>
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fb92cdf36371a4b4eb65b7360d292cd11%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/9.jpg saved to cache
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 572fb211-c34a-540b-b492-e638d580713e
2026-03-24 22:58:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 572fb211-c34a-540b-b492-e638d580713e, skipping ID generation
2026-03-24 22:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572fb211-c34a-540b-b492-e638d580713e with scrape type 1
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 572fb211-c34a-540b-b492-e638d580713e sending to next pipeline
2026-03-24 22:58:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 572fb211-c34a-540b-b492-e638d580713e, identifier: 1980586
2026-03-24 22:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1980586
2026-03-24 22:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1980586
2026-03-24 22:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 572fb211-c34a-540b-b492-e638d580713e with identifier: 1980586 to the API
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '572fb211-c34a-540b-b492-e638d580713e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 Sportback',
 'odometer': 112798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fb211-c34a-540b-b492-e638d580713e/572fb211-c34a-540b-b492-e638d580713e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/b92cdf36371a4b4eb65b7360d292cd11/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Sportback 2.0 50 TFSI E S TRONIC QUATTRO S LINE',
 'transmission': 'automatic',
 'trim': '2.0 50 TFSI E S TRONIC QUATTRO S LINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980586%27 HTTP/1.1" 200 None
2026-03-24 22:58:47 [ayvens.be] INFO: Saving data for 1980586: {'created_time': 1774393127.684347, 'last_price_update_time': 1774393127.684358, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980586') HTTP/1.1" 204 0
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/2.jpg not downloaded yet
2026-03-24 22:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/3.jpg not downloaded yet
2026-03-24 22:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008339050>
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/1.jpg saved to cache
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/4.jpg not downloaded yet
2026-03-24 22:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/5.jpg not downloaded yet
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b53210>
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/2.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d7a50>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/4.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b46c10>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/5.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/6.jpg not downloaded yet
2026-03-24 22:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008369bd0>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/3.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/7.jpg not downloaded yet
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed3010>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/6.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093ccd10>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/7.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/8.jpg not downloaded yet
2026-03-24 22:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945d0d0>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/8.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/9.jpg not downloaded yet
2026-03-24 22:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/10.jpg not downloaded yet
2026-03-24 22:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:48 [ayvens.be] INFO: Found listing with ID: 1980589
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980589%27 HTTP/1.1" 200 None
2026-03-24 22:58:48 [ayvens.be] INFO: Scrape type for 1980589: 1
2026-03-24 22:58:48 [ayvens.be] INFO: Extracting data for car ID: 1980589
2026-03-24 22:58:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with identifier: 1980589
2026-03-24 22:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with scrape type 1
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/1.jpg not downloaded yet
2026-03-24 22:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945e810>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/1.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091403d0>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/2.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008335550>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/3.jpg saved to cache
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/2.jpg not downloaded yet
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/3.jpg not downloaded yet
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008338bd0>
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/9.jpg saved to cache
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bd350>
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/4.jpg saved to cache
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008309290>
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/5.jpg saved to cache
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097895d0>
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252F9029497a67f0411bb54d11eed38e10f4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/10.jpg saved to cache
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f18e9342-4f12-553c-b02c-5645e403a20a
2026-03-24 22:58:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f18e9342-4f12-553c-b02c-5645e403a20a, skipping ID generation
2026-03-24 22:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f18e9342-4f12-553c-b02c-5645e403a20a with scrape type 1
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f18e9342-4f12-553c-b02c-5645e403a20a sending to next pipeline
2026-03-24 22:58:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f18e9342-4f12-553c-b02c-5645e403a20a, identifier: 1980587
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b547090>
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/6.jpg saved to cache
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1980587
2026-03-24 22:58:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1980587
2026-03-24 22:58:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f18e9342-4f12-553c-b02c-5645e403a20a with identifier: 1980587 to the API
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f18e9342-4f12-553c-b02c-5645e403a20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 83319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f18e9342-4f12-553c-b02c-5645e403a20a/f18e9342-4f12-553c-b02c-5645e403a20a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/9029497a67f0411bb54d11eed38e10f4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980587%27 HTTP/1.1" 200 None
2026-03-24 22:58:49 [ayvens.be] INFO: Saving data for 1980587: {'created_time': 1774393129.77036, 'last_price_update_time': 1774393129.770376, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980587') HTTP/1.1" 204 0
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/4.jpg not downloaded yet
2026-03-24 22:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/5.jpg not downloaded yet
2026-03-24 22:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b6cef10>
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/7.jpg saved to cache
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/6.jpg not downloaded yet
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/7.jpg not downloaded yet
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/8.jpg not downloaded yet
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1b8650>
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/9.jpg saved to cache
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d08d0>
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/8.jpg saved to cache
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009564d50>
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/1.jpg saved to cache
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/9.jpg not downloaded yet
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/10.jpg not downloaded yet
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cd98d0>
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fa5b01378279242fe9606e08bc9ce5861%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/10.jpg saved to cache
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed
2026-03-24 22:58:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed, skipping ID generation
2026-03-24 22:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with scrape type 1
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed sending to next pipeline
2026-03-24 22:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed, identifier: 1980588
2026-03-24 22:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1980588
2026-03-24 22:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1980588
2026-03-24 22:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b548f02-98e7-5a1f-81a8-5a1c0ec365ed with identifier: 1980588 to the API
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b548f02-98e7-5a1f-81a8-5a1c0ec365ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 84231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b548f02-98e7-5a1f-81a8-5a1c0ec365ed/1b548f02-98e7-5a1f-81a8-5a1c0ec365ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/a5b01378279242fe9606e08bc9ce5861/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 81KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 81KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980588%27 HTTP/1.1" 200 None
2026-03-24 22:58:50 [ayvens.be] INFO: Saving data for 1980588: {'created_time': 1774393130.775798, 'last_price_update_time': 1774393130.775807, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980588') HTTP/1.1" 204 0
2026-03-24 22:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:50 [ayvens.be] INFO: Found listing with ID: 1980590
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980590%27 HTTP/1.1" 200 None
2026-03-24 22:58:50 [ayvens.be] INFO: Scrape type for 1980590: 1
2026-03-24 22:58:50 [ayvens.be] INFO: Extracting data for car ID: 1980590
2026-03-24 22:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with identifier: 1980590
2026-03-24 22:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with scrape type 1
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/1.jpg not downloaded yet
2026-03-24 22:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/2.jpg not downloaded yet
2026-03-24 22:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/3.jpg not downloaded yet
2026-03-24 22:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/4.jpg not downloaded yet
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/5.jpg not downloaded yet
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f8c50>
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/3.jpg saved to cache
2026-03-24 22:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009187c50>
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/6.jpg saved to cache
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/6.jpg not downloaded yet
2026-03-24 22:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/7.jpg not downloaded yet
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009459950>
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/4.jpg saved to cache
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008334450>
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/5.jpg saved to cache
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f3c90>
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/2.jpg saved to cache
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d9290>
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/7.jpg saved to cache
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc59d0>
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/8.jpg saved to cache
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/8.jpg not downloaded yet
2026-03-24 22:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/9.jpg not downloaded yet
2026-03-24 22:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096c6290>
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/9.jpg saved to cache
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/10.jpg not downloaded yet
2026-03-24 22:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:51 [ayvens.be] INFO: Found listing with ID: 1980591
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980591%27 HTTP/1.1" 200 None
2026-03-24 22:58:51 [ayvens.be] INFO: Scrape type for 1980591: 1
2026-03-24 22:58:51 [ayvens.be] INFO: Extracting data for car ID: 1980591
2026-03-24 22:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17ed58f7-556f-5b74-8723-4dac22a8dc51 with identifier: 1980591
2026-03-24 22:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ed58f7-556f-5b74-8723-4dac22a8dc51 with scrape type 1
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/1.jpg not downloaded yet
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/2.jpg not downloaded yet
2026-03-24 22:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeac950>
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/1.jpg saved to cache
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083343d0>
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F09e98e67ade0429d85e4017ad2b0bac3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/10.jpg saved to cache
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb
2026-03-24 22:58:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb, skipping ID generation
2026-03-24 22:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with scrape type 1
2026-03-24 22:58:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb sending to next pipeline
2026-03-24 22:58:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb, identifier: 1980589
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bfd90>
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/2.jpg saved to cache
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910ee50>
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/3.jpg saved to cache
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/3.jpg not downloaded yet
2026-03-24 22:58:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with identifier: 1980589
2026-03-24 22:58:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with identifier: 1980589
2026-03-24 22:58:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09a43b0a-c88e-5129-a2da-10bd3bc2cdeb with identifier: 1980589 to the API
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '09a43b0a-c88e-5129-a2da-10bd3bc2cdeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 83345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a43b0a-c88e-5129-a2da-10bd3bc2cdeb/09a43b0a-c88e-5129-a2da-10bd3bc2cdeb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/09e98e67ade0429d85e4017ad2b0bac3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 CLA 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2020}
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980589%27 HTTP/1.1" 200 None
2026-03-24 22:58:52 [ayvens.be] INFO: Saving data for 1980589: {'created_time': 1774393132.516815, 'last_price_update_time': 1774393132.516824, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980589') HTTP/1.1" 204 0
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/4.jpg not downloaded yet
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008336690>
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/5.jpg saved to cache
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910de50>
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/4.jpg saved to cache
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a35d0>
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/6.jpg saved to cache
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009133150>
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/7.jpg saved to cache
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/5.jpg not downloaded yet
2026-03-24 22:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/6.jpg not downloaded yet
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/7.jpg not downloaded yet
2026-03-24 22:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/8.jpg not downloaded yet
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/9.jpg not downloaded yet
2026-03-24 22:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/10.jpg not downloaded yet
2026-03-24 22:58:53 [ayvens.be] INFO: Found listing with ID: 1980592
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980592%27 HTTP/1.1" 200 None
2026-03-24 22:58:53 [ayvens.be] INFO: Scrape type for 1980592: 1
2026-03-24 22:58:53 [ayvens.be] INFO: Extracting data for car ID: 1980592
2026-03-24 22:58:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fb59134-da48-5c7e-a086-4bfa1e78a1cd with identifier: 1980592
2026-03-24 22:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd with scrape type 1
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/1.jpg not downloaded yet
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a9fd0>
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/9.jpg saved to cache
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/2.jpg not downloaded yet
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b51750>
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/8.jpg saved to cache
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099434d0>
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F4a77b1a8af80411080ea2071797ffae4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/10.jpg saved to cache
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd
2026-03-24 22:58:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd, skipping ID generation
2026-03-24 22:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with scrape type 1
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ef9c29c-4908-50f3-871c-d2d1f98c96dd sending to next pipeline
2026-03-24 22:58:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd, identifier: 1980590
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cb0810>
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/1.jpg saved to cache
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/3.jpg not downloaded yet
2026-03-24 22:58:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with identifier: 1980590
2026-03-24 22:58:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with identifier: 1980590
2026-03-24 22:58:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0ef9c29c-4908-50f3-871c-d2d1f98c96dd with identifier: 1980590 to the API
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '0ef9c29c-4908-50f3-871c-d2d1f98c96dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 44650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ef9c29c-4908-50f3-871c-d2d1f98c96dd/0ef9c29c-4908-50f3-871c-d2d1f98c96dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/4a77b1a8af80411080ea2071797ffae4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 50 KWH ELECTRIQUE E-208 AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '50 KWH ELECTRIQUE E-208 AUTO ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980590%27 HTTP/1.1" 200 None
2026-03-24 22:58:53 [ayvens.be] INFO: Saving data for 1980590: {'created_time': 1774393133.945771, 'last_price_update_time': 1774393133.945781, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980590') HTTP/1.1" 204 0
2026-03-24 22:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/4.jpg not downloaded yet
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009a2f990>
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/2.jpg saved to cache
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1bbdd0>
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/3.jpg saved to cache
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/5.jpg not downloaded yet
2026-03-24 22:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967ce90>
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/4.jpg saved to cache
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913d810>
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/6.jpg saved to cache
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/6.jpg not downloaded yet
2026-03-24 22:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/7.jpg not downloaded yet
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009193950>
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/5.jpg saved to cache
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917fa10>
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/8.jpg saved to cache
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910d450>
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/9.jpg saved to cache
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00914cc10>
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/7.jpg saved to cache
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/8.jpg not downloaded yet
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/9.jpg not downloaded yet
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441210>
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fa11c7886221f48ae96e4d27435e23025%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/10.jpg saved to cache
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17ed58f7-556f-5b74-8723-4dac22a8dc51
2026-03-24 22:58:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17ed58f7-556f-5b74-8723-4dac22a8dc51, skipping ID generation
2026-03-24 22:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ed58f7-556f-5b74-8723-4dac22a8dc51 with scrape type 1
2026-03-24 22:58:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17ed58f7-556f-5b74-8723-4dac22a8dc51 sending to next pipeline
2026-03-24 22:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17ed58f7-556f-5b74-8723-4dac22a8dc51, identifier: 1980591
2026-03-24 22:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17ed58f7-556f-5b74-8723-4dac22a8dc51 with identifier: 1980591
2026-03-24 22:58:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17ed58f7-556f-5b74-8723-4dac22a8dc51 with identifier: 1980591
2026-03-24 22:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17ed58f7-556f-5b74-8723-4dac22a8dc51 with identifier: 1980591 to the API
2026-03-24 22:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '17ed58f7-556f-5b74-8723-4dac22a8dc51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 42721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ed58f7-556f-5b74-8723-4dac22a8dc51/17ed58f7-556f-5b74-8723-4dac22a8dc51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/a11c7886221f48ae96e4d27435e23025/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2022}
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980591%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [ayvens.be] INFO: Saving data for 1980591: {'created_time': 1774393135.208104, 'last_price_update_time': 1774393135.208116, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980591') HTTP/1.1" 204 0
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/10.jpg not downloaded yet
2026-03-24 22:58:55 [ayvens.be] INFO: Found listing with ID: 1980593
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980593%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [ayvens.be] INFO: Scrape type for 1980593: 1
2026-03-24 22:58:55 [ayvens.be] INFO: Extracting data for car ID: 1980593
2026-03-24 22:58:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with identifier: 1980593
2026-03-24 22:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with scrape type 1
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/1.jpg not downloaded yet
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00915fc10>
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/1.jpg saved to cache
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/2.jpg not downloaded yet
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/3.jpg not downloaded yet
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/4.jpg not downloaded yet
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cdb750>
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/3.jpg saved to cache
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/5.jpg not downloaded yet
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/6.jpg not downloaded yet
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945fe50>
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/2.jpg saved to cache
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097d5c90>
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/5.jpg saved to cache
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009190890>
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/4.jpg saved to cache
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971a390>
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/6.jpg saved to cache
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/7.jpg not downloaded yet
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00983a8d0>
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/7.jpg saved to cache
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/8.jpg not downloaded yet
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/9.jpg not downloaded yet
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/10.jpg not downloaded yet
2026-03-24 22:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b47f10>
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/9.jpg saved to cache
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:56 [ayvens.be] INFO: Found listing with ID: 1980594
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980594%27 HTTP/1.1" 200 None
2026-03-24 22:58:56 [ayvens.be] INFO: Scrape type for 1980594: 1
2026-03-24 22:58:56 [ayvens.be] INFO: Extracting data for car ID: 1980594
2026-03-24 22:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 304e62fe-2284-5029-9be9-c718b6fbf14f with identifier: 1980594
2026-03-24 22:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 304e62fe-2284-5029-9be9-c718b6fbf14f with scrape type 1
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/1.jpg not downloaded yet
2026-03-24 22:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945be50>
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/8.jpg saved to cache
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/2.jpg not downloaded yet
2026-03-24 22:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b3b14d0>
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/1.jpg saved to cache
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b1ba3d0>
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/2.jpg saved to cache
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0091ae2d0>
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F6d02d8b7d71b419a832b016460987696%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/10.jpg saved to cache
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd
2026-03-24 22:58:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fb59134-da48-5c7e-a086-4bfa1e78a1cd, skipping ID generation
2026-03-24 22:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd with scrape type 1
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fb59134-da48-5c7e-a086-4bfa1e78a1cd sending to next pipeline
2026-03-24 22:58:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1fb59134-da48-5c7e-a086-4bfa1e78a1cd, identifier: 1980592
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a0e50>
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/3.jpg saved to cache
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/3.jpg not downloaded yet
2026-03-24 22:58:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1fb59134-da48-5c7e-a086-4bfa1e78a1cd with identifier: 1980592
2026-03-24 22:58:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1fb59134-da48-5c7e-a086-4bfa1e78a1cd with identifier: 1980592
2026-03-24 22:58:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1fb59134-da48-5c7e-a086-4bfa1e78a1cd with identifier: 1980592 to the API
2026-03-24 22:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1fb59134-da48-5c7e-a086-4bfa1e78a1cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 45655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb59134-da48-5c7e-a086-4bfa1e78a1cd/1fb59134-da48-5c7e-a086-4bfa1e78a1cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/6d02d8b7d71b419a832b016460987696/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 PLUS LIMITED EDITION AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 PLUS LIMITED EDITION AUTO',
 'vin': None,
 'year': 2024}
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980592%27 HTTP/1.1" 200 None
2026-03-24 22:58:57 [ayvens.be] INFO: Saving data for 1980592: {'created_time': 1774393137.14882, 'last_price_update_time': 1774393137.148832, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980592') HTTP/1.1" 204 0
2026-03-24 22:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f2b50>
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/4.jpg saved to cache
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/4.jpg not downloaded yet
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f0510>
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/5.jpg saved to cache
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/5.jpg not downloaded yet
2026-03-24 22:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b50c50>
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/6.jpg saved to cache
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/6.jpg not downloaded yet
2026-03-24 22:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094bff10>
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/8.jpg saved to cache
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/7.jpg not downloaded yet
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009440750>
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/9.jpg saved to cache
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f22d0>
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/7.jpg saved to cache
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/8.jpg not downloaded yet
2026-03-24 22:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/9.jpg not downloaded yet
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a0a10>
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F8c0e84992b254f81ac82bee839fbe61e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/10.jpg saved to cache
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8
2026-03-24 22:58:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8, skipping ID generation
2026-03-24 22:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with scrape type 1
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 sending to next pipeline
2026-03-24 22:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8, identifier: 1980593
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009615a50>
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/1.jpg saved to cache
2026-03-24 22:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with identifier: 1980593
2026-03-24 22:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with identifier: 1980593
2026-03-24 22:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8 with identifier: 1980593 to the API
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 76254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8/33e8cf4f-5fbe-503a-9c8f-93d0d779f4f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/8c0e84992b254f81ac82bee839fbe61e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980593%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [ayvens.be] INFO: Saving data for 1980593: {'created_time': 1774393138.309031, 'last_price_update_time': 1774393138.309041, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980593') HTTP/1.1" 204 0
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/10.jpg not downloaded yet
2026-03-24 22:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed1450>
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/2.jpg saved to cache
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406e50>
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/3.jpg saved to cache
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:58 [ayvens.be] INFO: Found listing with ID: 1980595
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980595%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [ayvens.be] INFO: Scrape type for 1980595: 1
2026-03-24 22:58:58 [ayvens.be] INFO: Extracting data for car ID: 1980595
2026-03-24 22:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1256ce21-2938-5b93-a2c3-c014e79ced2a with identifier: 1980595
2026-03-24 22:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1256ce21-2938-5b93-a2c3-c014e79ced2a with scrape type 1
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/1.jpg not downloaded yet
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/2.jpg not downloaded yet
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009567e50>
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/4.jpg saved to cache
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7dd0>
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/5.jpg saved to cache
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/3.jpg not downloaded yet
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/4.jpg not downloaded yet
2026-03-24 22:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/5.jpg not downloaded yet
2026-03-24 22:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/6.jpg not downloaded yet
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/7.jpg not downloaded yet
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/8.jpg not downloaded yet
2026-03-24 22:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/9.jpg not downloaded yet
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f0350>
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/6.jpg saved to cache
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc6350>
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/7.jpg saved to cache
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/10.jpg not downloaded yet
2026-03-24 22:58:59 [ayvens.be] INFO: Found listing with ID: 1980596
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980596%27 HTTP/1.1" 200 None
2026-03-24 22:58:59 [ayvens.be] INFO: Scrape type for 1980596: 1
2026-03-24 22:58:59 [ayvens.be] INFO: Extracting data for car ID: 1980596
2026-03-24 22:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1980596
2026-03-24 22:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903e1390-8721-55ae-9697-cc1db8002744 with scrape type 1
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/1.jpg not downloaded yet
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009940e50>
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/8.jpg saved to cache
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008386150>
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/9.jpg saved to cache
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083a94d0>
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3bcb89277f9c4310b1e041b1385004be%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/10.jpg saved to cache
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 304e62fe-2284-5029-9be9-c718b6fbf14f
2026-03-24 22:58:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 304e62fe-2284-5029-9be9-c718b6fbf14f, skipping ID generation
2026-03-24 22:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 304e62fe-2284-5029-9be9-c718b6fbf14f with scrape type 1
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 304e62fe-2284-5029-9be9-c718b6fbf14f sending to next pipeline
2026-03-24 22:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 304e62fe-2284-5029-9be9-c718b6fbf14f, identifier: 1980594
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00971b610>
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/1.jpg saved to cache
2026-03-24 22:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 304e62fe-2284-5029-9be9-c718b6fbf14f with identifier: 1980594
2026-03-24 22:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 304e62fe-2284-5029-9be9-c718b6fbf14f with identifier: 1980594
2026-03-24 22:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 304e62fe-2284-5029-9be9-c718b6fbf14f with identifier: 1980594 to the API
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '304e62fe-2284-5029-9be9-c718b6fbf14f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 64095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_304e62fe-2284-5029-9be9-c718b6fbf14f/304e62fe-2284-5029-9be9-c718b6fbf14f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3bcb89277f9c4310b1e041b1385004be/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980594%27 HTTP/1.1" 200 None
2026-03-24 22:58:59 [ayvens.be] INFO: Saving data for 1980594: {'created_time': 1774393139.979796, 'last_price_update_time': 1774393139.979805, 'auction_closing_time': 1774530000.0}
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980594') HTTP/1.1" 204 0
2026-03-24 22:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/2.jpg not downloaded yet
2026-03-24 22:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/3.jpg not downloaded yet
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009395f10>
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/3.jpg saved to cache
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/4.jpg not downloaded yet
2026-03-24 22:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/5.jpg not downloaded yet
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009157950>
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/2.jpg saved to cache
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00963ab90>
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/7.jpg saved to cache
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093da250>
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/6.jpg saved to cache
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008370190>
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/4.jpg saved to cache
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093d9850>
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/5.jpg saved to cache
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/6.jpg not downloaded yet
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097ab390>
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/9.jpg saved to cache
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aecf750>
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/8.jpg saved to cache
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00917ee10>
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252F8a07d0dd596e4ebd9917e9c174511a2e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/10.jpg saved to cache
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1256ce21-2938-5b93-a2c3-c014e79ced2a
2026-03-24 22:59:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1256ce21-2938-5b93-a2c3-c014e79ced2a, skipping ID generation
2026-03-24 22:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1256ce21-2938-5b93-a2c3-c014e79ced2a with scrape type 1
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1256ce21-2938-5b93-a2c3-c014e79ced2a sending to next pipeline
2026-03-24 22:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1256ce21-2938-5b93-a2c3-c014e79ced2a, identifier: 1980595
2026-03-24 22:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/7.jpg not downloaded yet
2026-03-24 22:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1256ce21-2938-5b93-a2c3-c014e79ced2a with identifier: 1980595
2026-03-24 22:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1256ce21-2938-5b93-a2c3-c014e79ced2a with identifier: 1980595
2026-03-24 22:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1256ce21-2938-5b93-a2c3-c014e79ced2a with identifier: 1980595 to the API
2026-03-24 22:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1256ce21-2938-5b93-a2c3-c014e79ced2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 49697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399941,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1256ce21-2938-5b93-a2c3-c014e79ced2a/1256ce21-2938-5b93-a2c3-c014e79ced2a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/8a07d0dd596e4ebd9917e9c174511a2e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TSI 130 MOVE!',
 'transmission': 'manual',
 'trim': '1.5 TSI 130 MOVE!',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980595%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [ayvens.be] INFO: Saving data for 1980595: {'created_time': 1774393141.130564, 'last_price_update_time': 1774393141.130575, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980595') HTTP/1.1" 204 0
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/8.jpg not downloaded yet
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978a190>
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/1.jpg saved to cache
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/9.jpg not downloaded yet
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/10.jpg not downloaded yet
2026-03-24 22:59:01 [ayvens.be] INFO: Found listing with ID: 1980597
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980597%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [ayvens.be] INFO: Scrape type for 1980597: 1
2026-03-24 22:59:01 [ayvens.be] INFO: Extracting data for car ID: 1980597
2026-03-24 22:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1980597
2026-03-24 22:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6db055-8436-5ac6-ad95-391afd5bbc80 with scrape type 1
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/1.jpg not downloaded yet
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/2.jpg not downloaded yet
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/3.jpg not downloaded yet
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098bff90>
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/2.jpg saved to cache
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093c1190>
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/3.jpg saved to cache
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/4.jpg not downloaded yet
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/5.jpg not downloaded yet
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00946c210>
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/4.jpg saved to cache
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093fbad0>
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/5.jpg saved to cache
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00913e850>
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/6.jpg saved to cache
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/6.jpg not downloaded yet
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/7.jpg not downloaded yet
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/8.jpg not downloaded yet
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/9.jpg not downloaded yet
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/10.jpg not downloaded yet
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [ayvens.be] INFO: Found listing with ID: 1980598
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980598%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [ayvens.be] INFO: Scrape type for 1980598: 1
2026-03-24 22:59:01 [ayvens.be] INFO: Extracting data for car ID: 1980598
2026-03-24 22:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1980598
2026-03-24 22:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9123352f-f020-520c-8c81-3f437f438310 with scrape type 1
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/1.jpg not downloaded yet
2026-03-24 22:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/2.jpg not downloaded yet
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00962f450>
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/9.jpg saved to cache
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145b10>
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/7.jpg saved to cache
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093f96d0>
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/8.jpg saved to cache
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945f390>
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F1f861bfac9474e9d9f8ba197a6b2c05a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/10.jpg saved to cache
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 903e1390-8721-55ae-9697-cc1db8002744
2026-03-24 22:59:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 903e1390-8721-55ae-9697-cc1db8002744, skipping ID generation
2026-03-24 22:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903e1390-8721-55ae-9697-cc1db8002744 with scrape type 1
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 903e1390-8721-55ae-9697-cc1db8002744 sending to next pipeline
2026-03-24 22:59:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 903e1390-8721-55ae-9697-cc1db8002744, identifier: 1980596
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/3.jpg not downloaded yet
2026-03-24 22:59:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1980596
2026-03-24 22:59:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1980596
2026-03-24 22:59:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 903e1390-8721-55ae-9697-cc1db8002744 with identifier: 1980596 to the API
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '903e1390-8721-55ae-9697-cc1db8002744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 86016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e1390-8721-55ae-9697-cc1db8002744/903e1390-8721-55ae-9697-cc1db8002744_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/1f861bfac9474e9d9f8ba197a6b2c05a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980596%27 HTTP/1.1" 200 None
2026-03-24 22:59:02 [ayvens.be] INFO: Saving data for 1980596: {'created_time': 1774393142.635489, 'last_price_update_time': 1774393142.635498, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980596') HTTP/1.1" 204 0
2026-03-24 22:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/4.jpg not downloaded yet
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cd6d0>
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/1.jpg saved to cache
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096f0490>
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/2.jpg saved to cache
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083abe50>
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/3.jpg saved to cache
2026-03-24 22:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/5.jpg not downloaded yet
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008387bd0>
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/4.jpg saved to cache
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009d94a50>
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/5.jpg saved to cache
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/6.jpg not downloaded yet
2026-03-24 22:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/7.jpg not downloaded yet
2026-03-24 22:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/8.jpg not downloaded yet
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/9.jpg not downloaded yet
2026-03-24 22:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/10.jpg not downloaded yet
2026-03-24 22:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:03 [ayvens.be] INFO: Found listing with ID: 1980599
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980599%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [ayvens.be] INFO: Scrape type for 1980599: 1
2026-03-24 22:59:03 [ayvens.be] INFO: Extracting data for car ID: 1980599
2026-03-24 22:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2c7514b-09d5-589b-9f34-16877c439323 with identifier: 1980599
2026-03-24 22:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c7514b-09d5-589b-9f34-16877c439323 with scrape type 1
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/1.jpg not downloaded yet
2026-03-24 22:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/2.jpg not downloaded yet
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945fbd0>
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/6.jpg saved to cache
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093da250>
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/7.jpg saved to cache
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009145b90>
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/8.jpg saved to cache
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008373b50>
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/10.jpg saved to cache
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/3.jpg not downloaded yet
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00959cd50>
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252F1175f88998bc430b93acae8fefb5461d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/9.jpg saved to cache
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a6db055-8436-5ac6-ad95-391afd5bbc80
2026-03-24 22:59:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a6db055-8436-5ac6-ad95-391afd5bbc80, skipping ID generation
2026-03-24 22:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a6db055-8436-5ac6-ad95-391afd5bbc80 with scrape type 1
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a6db055-8436-5ac6-ad95-391afd5bbc80 sending to next pipeline
2026-03-24 22:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a6db055-8436-5ac6-ad95-391afd5bbc80, identifier: 1980597
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/4.jpg not downloaded yet
2026-03-24 22:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1980597
2026-03-24 22:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1980597
2026-03-24 22:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a6db055-8436-5ac6-ad95-391afd5bbc80 with identifier: 1980597 to the API
2026-03-24 22:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4a6db055-8436-5ac6-ad95-391afd5bbc80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 53093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a6db055-8436-5ac6-ad95-391afd5bbc80/4a6db055-8436-5ac6-ad95-391afd5bbc80_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/1175f88998bc430b93acae8fefb5461d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980597%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [ayvens.be] INFO: Saving data for 1980597: {'created_time': 1774393144.165718, 'last_price_update_time': 1774393144.16573, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980597') HTTP/1.1" 204 0
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009133090>
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/1.jpg saved to cache
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836a990>
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/2.jpg saved to cache
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009406f50>
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/3.jpg saved to cache
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/5.jpg not downloaded yet
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/6.jpg not downloaded yet
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/7.jpg not downloaded yet
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/8.jpg not downloaded yet
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/9.jpg not downloaded yet
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/10.jpg not downloaded yet
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0096a2e90>
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/5.jpg saved to cache
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:04 [ayvens.be] INFO: Found listing with ID: 1980600
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980600%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [ayvens.be] INFO: Scrape type for 1980600: 1
2026-03-24 22:59:04 [ayvens.be] INFO: Extracting data for car ID: 1980600
2026-03-24 22:59:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with identifier: 1980600
2026-03-24 22:59:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with scrape type 1
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/1.jpg not downloaded yet
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/2.jpg not downloaded yet
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/3.jpg not downloaded yet
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093cf990>
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/6.jpg saved to cache
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008385a90>
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/4.jpg saved to cache
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00916cd50>
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/9.jpg saved to cache
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911bf90>
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/7.jpg saved to cache
2026-03-24 22:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009155cd0>
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/8.jpg saved to cache
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00978b250>
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F78bd4e483a874bf9b665ce6cf9cf8c74%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/10.jpg saved to cache
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9123352f-f020-520c-8c81-3f437f438310
2026-03-24 22:59:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9123352f-f020-520c-8c81-3f437f438310, skipping ID generation
2026-03-24 22:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9123352f-f020-520c-8c81-3f437f438310 with scrape type 1
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9123352f-f020-520c-8c81-3f437f438310 sending to next pipeline
2026-03-24 22:59:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9123352f-f020-520c-8c81-3f437f438310, identifier: 1980598
2026-03-24 22:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1980598
2026-03-24 22:59:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1980598
2026-03-24 22:59:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9123352f-f020-520c-8c81-3f437f438310 with identifier: 1980598 to the API
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '9123352f-f020-520c-8c81-3f437f438310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 130264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9123352f-f020-520c-8c81-3f437f438310/9123352f-f020-520c-8c81-3f437f438310_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/78bd4e483a874bf9b665ce6cf9cf8c74/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980598%27 HTTP/1.1" 200 None
2026-03-24 22:59:05 [ayvens.be] INFO: Saving data for 1980598: {'created_time': 1774393145.565458, 'last_price_update_time': 1774393145.565495, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980598') HTTP/1.1" 204 0
2026-03-24 22:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/4.jpg not downloaded yet
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/5.jpg not downloaded yet
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098b6010>
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/3.jpg saved to cache
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008315690>
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/1.jpg saved to cache
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfcc90>
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/2.jpg saved to cache
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0099a16d0>
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/4.jpg saved to cache
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfea90>
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/5.jpg saved to cache
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093a0ed0>
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/6.jpg saved to cache
2026-03-24 22:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b95d0>
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/7.jpg saved to cache
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/6.jpg not downloaded yet
2026-03-24 22:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a8050>
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/8.jpg saved to cache
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/7.jpg not downloaded yet
2026-03-24 22:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/8.jpg not downloaded yet
2026-03-24 22:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/9.jpg not downloaded yet
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009629250>
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/9.jpg saved to cache
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/10.jpg not downloaded yet
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00836bfd0>
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252Fddb859d50eb14b838ec1e12cc80ff9fa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/10.jpg saved to cache
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2c7514b-09d5-589b-9f34-16877c439323
2026-03-24 22:59:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2c7514b-09d5-589b-9f34-16877c439323, skipping ID generation
2026-03-24 22:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2c7514b-09d5-589b-9f34-16877c439323 with scrape type 1
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2c7514b-09d5-589b-9f34-16877c439323 sending to next pipeline
2026-03-24 22:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2c7514b-09d5-589b-9f34-16877c439323, identifier: 1980599
2026-03-24 22:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:06 [ayvens.be] INFO: Found listing with ID: 1980601
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980601%27 HTTP/1.1" 200 None
2026-03-24 22:59:06 [ayvens.be] INFO: Scrape type for 1980601: 1
2026-03-24 22:59:06 [ayvens.be] INFO: Extracting data for car ID: 1980601
2026-03-24 22:59:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce4c819-f0b8-5c83-9a10-a643842c4e5e with identifier: 1980601
2026-03-24 22:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce4c819-f0b8-5c83-9a10-a643842c4e5e with scrape type 1
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/1.jpg not downloaded yet
2026-03-24 22:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2c7514b-09d5-589b-9f34-16877c439323 with identifier: 1980599
2026-03-24 22:59:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2c7514b-09d5-589b-9f34-16877c439323 with identifier: 1980599
2026-03-24 22:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2c7514b-09d5-589b-9f34-16877c439323 with identifier: 1980599 to the API
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'DARK MOON BLUE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd2c7514b-09d5-589b-9f34-16877c439323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA GRAND SPORT DIESEL',
 'odometer': 164248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2c7514b-09d5-589b-9f34-16877c439323/d2c7514b-09d5-589b-9f34-16877c439323_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/ddb859d50eb14b838ec1e12cc80ff9fa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA GRAND SPORT DIESEL 1.6 CDTI Edition (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.6 CDTI Edition (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980599%27 HTTP/1.1" 200 None
2026-03-24 22:59:06 [ayvens.be] INFO: Saving data for 1980599: {'created_time': 1774393146.876894, 'last_price_update_time': 1774393146.876905, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980599') HTTP/1.1" 204 0
2026-03-24 22:59:06 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 3 pages/min), scraped 589 items (at 40 items/min)
2026-03-24 22:59:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009009310>
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/1.jpg saved to cache
2026-03-24 22:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009667890>
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/2.jpg saved to cache
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/2.jpg not downloaded yet
2026-03-24 22:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008382550>
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/3.jpg saved to cache
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/3.jpg not downloaded yet
2026-03-24 22:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/4.jpg not downloaded yet
2026-03-24 22:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/5.jpg not downloaded yet
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/6.jpg not downloaded yet
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083bec50>
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/4.jpg saved to cache
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00945c290>
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/5.jpg saved to cache
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a14d0>
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/6.jpg saved to cache
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/7.jpg not downloaded yet
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834fb10>
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/7.jpg saved to cache
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/8.jpg not downloaded yet
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009702890>
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/8.jpg saved to cache
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834fc90>
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/9.jpg saved to cache
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094a1890>
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F5ad270f1c89f4d7eb0132e66df10b2a1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/10.jpg saved to cache
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479
2026-03-24 22:59:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479, skipping ID generation
2026-03-24 22:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with scrape type 1
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 sending to next pipeline
2026-03-24 22:59:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479, identifier: 1980600
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/9.jpg not downloaded yet
2026-03-24 22:59:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with identifier: 1980600
2026-03-24 22:59:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:59:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with identifier: 1980600
2026-03-24 22:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7bf6eef3-8789-54b4-b1b1-35ea4c56a479 with identifier: 1980600 to the API
2026-03-24 22:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'MINERAL BLANC BRILLANT',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '7bf6eef3-8789-54b4-b1b1-35ea4c56a479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 17328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 416333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bf6eef3-8789-54b4-b1b1-35ea4c56a479/7bf6eef3-8789-54b4-b1b1-35ea4c56a479_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/5ad270f1c89f4d7eb0132e66df10b2a1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'transmission': 'automatic',
 'trim': 'BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980600%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [ayvens.be] INFO: Saving data for 1980600: {'created_time': 1774393148.176168, 'last_price_update_time': 1774393148.176178, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980600') HTTP/1.1" 204 0
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/10.jpg not downloaded yet
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [ayvens.be] INFO: Found listing with ID: 1980602
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980602%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [ayvens.be] INFO: Scrape type for 1980602: 1
2026-03-24 22:59:08 [ayvens.be] INFO: Extracting data for car ID: 1980602
2026-03-24 22:59:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1980602
2026-03-24 22:59:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with scrape type 1
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/1.jpg not downloaded yet
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/2.jpg not downloaded yet
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/3.jpg not downloaded yet
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/4.jpg not downloaded yet
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0094b17d0>
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/1.jpg saved to cache
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/5.jpg not downloaded yet
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/6.jpg not downloaded yet
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008315f10>
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/2.jpg saved to cache
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009473150>
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/3.jpg saved to cache
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093dadd0>
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/4.jpg saved to cache
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc7bd0>
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/5.jpg saved to cache
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/7.jpg not downloaded yet
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/8.jpg not downloaded yet
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009788750>
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/6.jpg saved to cache
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/9.jpg not downloaded yet
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/10.jpg not downloaded yet
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009638890>
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/7.jpg saved to cache
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:09 [ayvens.be] INFO: Found listing with ID: 1980603
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980603%27 HTTP/1.1" 200 None
2026-03-24 22:59:09 [ayvens.be] INFO: Scrape type for 1980603: 1
2026-03-24 22:59:09 [ayvens.be] INFO: Extracting data for car ID: 1980603
2026-03-24 22:59:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1980603
2026-03-24 22:59:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e27584de-cb42-5218-b907-d6972bd9fd0f with scrape type 1
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/1.jpg not downloaded yet
2026-03-24 22:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/2.jpg not downloaded yet
2026-03-24 22:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009009350>
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/9.jpg saved to cache
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083d5890>
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/2.jpg saved to cache
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009700a10>
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/10.jpg saved to cache
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0098b7990>
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Ffb7371407fbf4b1a8f2b7cfa9619d2be%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/8.jpg saved to cache
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bce4c819-f0b8-5c83-9a10-a643842c4e5e
2026-03-24 22:59:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bce4c819-f0b8-5c83-9a10-a643842c4e5e, skipping ID generation
2026-03-24 22:59:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce4c819-f0b8-5c83-9a10-a643842c4e5e with scrape type 1
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bce4c819-f0b8-5c83-9a10-a643842c4e5e sending to next pipeline
2026-03-24 22:59:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bce4c819-f0b8-5c83-9a10-a643842c4e5e, identifier: 1980601
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009119590>
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/3.jpg saved to cache
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/3.jpg not downloaded yet
2026-03-24 22:59:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bce4c819-f0b8-5c83-9a10-a643842c4e5e with identifier: 1980601
2026-03-24 22:59:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bce4c819-f0b8-5c83-9a10-a643842c4e5e with identifier: 1980601
2026-03-24 22:59:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bce4c819-f0b8-5c83-9a10-a643842c4e5e with identifier: 1980601 to the API
2026-03-24 22:59:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bce4c819-f0b8-5c83-9a10-a643842c4e5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 92887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 902011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 877712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce4c819-f0b8-5c83-9a10-a643842c4e5e/bce4c819-f0b8-5c83-9a10-a643842c4e5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/fb7371407fbf4b1a8f2b7cfa9619d2be/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980601%27 HTTP/1.1" 200 None
2026-03-24 22:59:10 [ayvens.be] INFO: Saving data for 1980601: {'created_time': 1774393150.649641, 'last_price_update_time': 1774393150.649649, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980601') HTTP/1.1" 204 0
2026-03-24 22:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/4.jpg not downloaded yet
2026-03-24 22:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00ca56490>
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/1.jpg saved to cache
2026-03-24 22:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aed3450>
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/4.jpg saved to cache
2026-03-24 22:59:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967ed50>
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/5.jpg saved to cache
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/5.jpg not downloaded yet
2026-03-24 22:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/6.jpg not downloaded yet
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009142250>
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/6.jpg saved to cache
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aeafd50>
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/7.jpg saved to cache
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009b44790>
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/8.jpg saved to cache
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/7.jpg not downloaded yet
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/8.jpg not downloaded yet
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097a89d0>
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/9.jpg saved to cache
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0097aa790>
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252Fe25bb052dc594637b34db27e1f9dd3b0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/10.jpg saved to cache
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad
2026-03-24 22:59:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad, skipping ID generation
2026-03-24 22:59:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with scrape type 1
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ac0fe51-d303-5c51-b4c4-e751c647c8ad sending to next pipeline
2026-03-24 22:59:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad, identifier: 1980602
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/9.jpg not downloaded yet
2026-03-24 22:59:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1980602
2026-03-24 22:59:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1980602
2026-03-24 22:59:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7ac0fe51-d303-5c51-b4c4-e751c647c8ad with identifier: 1980602 to the API
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ac0fe51-d303-5c51-b4c4-e751c647c8ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 123145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ac0fe51-d303-5c51-b4c4-e751c647c8ad/7ac0fe51-d303-5c51-b4c4-e751c647c8ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/e25bb052dc594637b34db27e1f9dd3b0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'vin': None,
 'year': 2020}
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980602%27 HTTP/1.1" 200 None
2026-03-24 22:59:11 [ayvens.be] INFO: Saving data for 1980602: {'created_time': 1774393151.888226, 'last_price_update_time': 1774393151.888235, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980602') HTTP/1.1" 204 0
2026-03-24 22:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/10.jpg not downloaded yet
2026-03-24 22:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b547410>
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/1.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:12 [ayvens.be] INFO: Found listing with ID: 1980604
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980604%27 HTTP/1.1" 200 None
2026-03-24 22:59:12 [ayvens.be] INFO: Scrape type for 1980604: 1
2026-03-24 22:59:12 [ayvens.be] INFO: Extracting data for car ID: 1980604
2026-03-24 22:59:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1980604
2026-03-24 22:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with scrape type 1
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/1.jpg not downloaded yet
2026-03-24 22:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/2.jpg not downloaded yet
2026-03-24 22:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc4d50>
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/3.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00944b0d0>
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/2.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00911b710>
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/4.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/3.jpg not downloaded yet
2026-03-24 22:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/4.jpg not downloaded yet
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009449a10>
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/5.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00834e890>
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/6.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cfd310>
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/7.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/5.jpg not downloaded yet
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/6.jpg not downloaded yet
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009762bd0>
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/8.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009441d90>
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/9.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/7.jpg not downloaded yet
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/8.jpg not downloaded yet
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00910ee50>
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F1a7f0bea48544324b5e2d124d13a2e83%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/10.jpg saved to cache
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e27584de-cb42-5218-b907-d6972bd9fd0f
2026-03-24 22:59:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e27584de-cb42-5218-b907-d6972bd9fd0f, skipping ID generation
2026-03-24 22:59:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e27584de-cb42-5218-b907-d6972bd9fd0f with scrape type 1
2026-03-24 22:59:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e27584de-cb42-5218-b907-d6972bd9fd0f sending to next pipeline
2026-03-24 22:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e27584de-cb42-5218-b907-d6972bd9fd0f, identifier: 1980603
2026-03-24 22:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/9.jpg not downloaded yet
2026-03-24 22:59:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1980603
2026-03-24 22:59:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1980603
2026-03-24 22:59:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e27584de-cb42-5218-b907-d6972bd9fd0f with identifier: 1980603 to the API
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e27584de-cb42-5218-b907-d6972bd9fd0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 110564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27584de-cb42-5218-b907-d6972bd9fd0f/e27584de-cb42-5218-b907-d6972bd9fd0f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/1a7f0bea48544324b5e2d124d13a2e83/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980603%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Saving data for 1980603: {'created_time': 1774393153.288686, 'last_price_update_time': 1774393153.288695, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980603') HTTP/1.1" 204 0
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/10.jpg not downloaded yet
2026-03-24 22:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff008cc5ad0>
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_1.jpg HTTP/1.1" 201 0
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/2.jpg saved to cache
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974467
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974467%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974467: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974468
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974468%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974468: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974469
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974469%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974469: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974470
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974470%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974470: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974471
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974471%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974471: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974472
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974472%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974472: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974473
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974473%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974473: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974474
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974474%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974474: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974475
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974475%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974475: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974476
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974476%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974476: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974477
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974477%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974477: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974478
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974478%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974478: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974479
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974479%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974479: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974480
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974480%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974480: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974481
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974481%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974481: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974482
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974482%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974482: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Found listing with ID: 1974483
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974483%27 HTTP/1.1" 200 None
2026-03-24 22:59:13 [ayvens.be] INFO: Scrape type for 1974483: 0
2026-03-24 22:59:13 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 700
2026-03-24 22:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff017690cd0>
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_2.jpg HTTP/1.1" 201 0
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/3.jpg saved to cache
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00aec6190>
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_4.jpg HTTP/1.1" 201 0
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/5.jpg saved to cache
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0093b8d90>
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_3.jpg HTTP/1.1" 201 0
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/4.jpg saved to cache
2026-03-24 22:59:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009760e50>
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_5.jpg HTTP/1.1" 201 0
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/6.jpg saved to cache
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff0083b5950>
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_6.jpg HTTP/1.1" 201 0
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/7.jpg saved to cache
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00967f290>
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_7.jpg HTTP/1.1" 201 0
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/8.jpg saved to cache
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009863010>
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_8.jpg HTTP/1.1" 201 0
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/9.jpg saved to cache
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff00b448650>
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_0.jpg HTTP/1.1" 201 0
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/1.jpg saved to cache
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff009761810>
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-24 22:59:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_9.jpg HTTP/1.1" 201 0
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252Fabdd0a9dc32046d98373c4b2790c77ce%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/10.jpg saved to cache
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce
2026-03-24 22:59:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce, skipping ID generation
2026-03-24 22:59:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with scrape type 1
2026-03-24 22:59:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80018c57-88ef-58a6-b4d1-48e1d08fa0ce sending to next pipeline
2026-03-24 22:59:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce, identifier: 1980604
2026-03-24 22:59:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1980604
2026-03-24 22:59:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1980604
2026-03-24 22:59:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80018c57-88ef-58a6-b4d1-48e1d08fa0ce with identifier: 1980604 to the API
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '80018c57-88ef-58a6-b4d1-48e1d08fa0ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 116706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80018c57-88ef-58a6-b4d1-48e1d08fa0ce/80018c57-88ef-58a6-b4d1-48e1d08fa0ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/abdd0a9dc32046d98373c4b2790c77ce/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980604%27 HTTP/1.1" 200 None
2026-03-24 22:59:14 [ayvens.be] INFO: Saving data for 1980604: {'created_time': 1774393154.844897, 'last_price_update_time': 1774393154.844909, 'auction_closing_time': 1774530000.0}
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980604') HTTP/1.1" 204 0
2026-03-24 22:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974484
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974484%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974484: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974485
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974485%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974485: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974486
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974486%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974486: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974487
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974487%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974487: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974488
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974488%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974488: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974489
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974489%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974489: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974490
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974490%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974490: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974491
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974491%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974491: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974492
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974492%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974492: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974493
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974493%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974493: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974494
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974494%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974494: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974495
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974495%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974495: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974496
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974496%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974496: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974497
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974497%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974497: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974498
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974498%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974498: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974499
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974499%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974499: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974500
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974500%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974500: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974501
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974501%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974501: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974502
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974502%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974502: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974503
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974503%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974503: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974504
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974504%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974504: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974505
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974505%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974505: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974506
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974506%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974506: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974507
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974507%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974507: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974508
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974508%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974508: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974509
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974509%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974509: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974510
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974510%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974510: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974511
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974511%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974511: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974512
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974512%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974512: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974513
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974513%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974513: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974514
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974514%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974514: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974515
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974515%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974515: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974516
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974516%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974516: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974517
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974517%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974517: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974518
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974518%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974518: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974519
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974519%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974519: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974520
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974520%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974520: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974521
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974521%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974521: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974522
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974522%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974522: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974523
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974523%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974523: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974524
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974524%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974524: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974525
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974525%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974525: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974526
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974526%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974526: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974527
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974527%27 HTTP/1.1" 200 None
2026-03-24 22:59:22 [ayvens.be] INFO: Scrape type for 1974527: 0
2026-03-24 22:59:22 [ayvens.be] INFO: Found listing with ID: 1974528
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974528%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974528: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974529
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974529%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974529: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974530
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974530%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974530: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974531
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974531%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974531: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974532
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974532%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974532: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974533
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974533%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974533: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974534
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974534%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974534: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974535
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974535%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974535: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974536
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974536%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974536: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974537
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974537%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974537: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974538
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974538%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974538: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974539
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974539%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974539: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974540
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974540%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974540: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974541
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974541%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974541: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974542
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974542%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974542: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974543
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974543%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974543: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974544
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974544%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974544: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974545
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974545%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974545: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974546
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974546%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974546: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974547
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974547%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974547: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974548
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974548%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974548: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974549
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974549%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974549: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974550
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974550%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974550: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974551
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974551%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974551: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974552
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974552%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974552: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974553
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974553%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974553: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974554
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974554%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974554: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974555
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974555%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974555: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974556
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974556%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974556: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974557
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974557%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974557: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974558
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974558%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974558: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974559
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974559%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974559: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974560
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974560%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974560: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974561
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974561%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974561: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974562
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974562%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974562: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974563
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974563%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974563: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974564
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974564%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974564: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974565
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974565%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974565: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974566
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974566%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974566: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974567
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974567%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974567: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974568
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974568%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974568: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974569
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974569%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974569: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974570
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974570%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974570: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974571
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974571%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974571: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974572
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974572%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974572: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974573
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974573%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974573: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974574
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974574%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974574: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974575
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974575%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974575: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974576
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974576%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974576: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974577
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974577%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974577: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974578
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974578%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974578: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974579
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974579%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974579: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974580
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974580%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974580: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974581
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974581%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974581: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974582
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974582%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974582: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Found listing with ID: 1974583
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974583%27 HTTP/1.1" 200 None
2026-03-24 22:59:23 [ayvens.be] INFO: Scrape type for 1974583: 0
2026-03-24 22:59:23 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 800
2026-03-24 22:59:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974584
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974584%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974584: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974585
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974585%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974585: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974586
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974586%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974586: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974587
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974587%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974587: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974588
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974588%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974588: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974589
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974589%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974589: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974590
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974590%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974590: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974591
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974591%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974591: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974592
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974592%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974592: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974593
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974593%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974593: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974594
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974594%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974594: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974595
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974595%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974595: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974596
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974596%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974596: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1974597
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974597%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1974597: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1973285
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973285%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1973285: 0
2026-03-24 22:59:27 [ayvens.be] INFO: Found listing with ID: 1973286
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973286%27 HTTP/1.1" 200 None
2026-03-24 22:59:27 [ayvens.be] INFO: Scrape type for 1973286: 2
2026-03-24 22:59:27 [ayvens.be] INFO: Extracting data for car ID: 1973286
2026-03-24 22:59:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with identifier: 1973286
2026-03-24 22:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with scrape type 2
2026-03-24 22:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with scrape type 2
2026-03-24 22:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cbd8a953-b9cd-57bc-92b4-d1e5046c16bf, identifier: 1973286
2026-03-24 22:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with identifier: 1973286
2026-03-24 22:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with identifier: 1973286
2026-03-24 22:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cbd8a953-b9cd-57bc-92b4-d1e5046c16bf with identifier: 1973286 to the API
2026-03-24 22:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cbd8a953-b9cd-57bc-92b4-d1e5046c16bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 54292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973286%27 HTTP/1.1" 200 None
2026-03-24 22:59:29 [ayvens.be] INFO: Saving data for 1973286: {'auction_closing_time': 1774436400.0, 'created_time': 1774003556.042015, 'last_price_update_time': 1774393169.174688}
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973286') HTTP/1.1" 204 0
2026-03-24 22:59:29 [ayvens.be] INFO: Found listing with ID: 1973287
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973287%27 HTTP/1.1" 200 None
2026-03-24 22:59:29 [ayvens.be] INFO: Scrape type for 1973287: 2
2026-03-24 22:59:29 [ayvens.be] INFO: Extracting data for car ID: 1973287
2026-03-24 22:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c495297b-3900-501a-8e27-624753909a2e with identifier: 1973287
2026-03-24 22:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c495297b-3900-501a-8e27-624753909a2e with scrape type 2
2026-03-24 22:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c495297b-3900-501a-8e27-624753909a2e with scrape type 2
2026-03-24 22:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c495297b-3900-501a-8e27-624753909a2e, identifier: 1973287
2026-03-24 22:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c495297b-3900-501a-8e27-624753909a2e with identifier: 1973287
2026-03-24 22:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c495297b-3900-501a-8e27-624753909a2e with identifier: 1973287
2026-03-24 22:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c495297b-3900-501a-8e27-624753909a2e with identifier: 1973287 to the API
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c495297b-3900-501a-8e27-624753909a2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 29843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973287%27 HTTP/1.1" 200 None
2026-03-24 22:59:29 [ayvens.be] INFO: Saving data for 1973287: {'auction_closing_time': 1774436400.0, 'created_time': 1774003554.227669, 'last_price_update_time': 1774393169.644755}
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973287') HTTP/1.1" 204 0
2026-03-24 22:59:29 [ayvens.be] INFO: Found listing with ID: 1973288
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973288%27 HTTP/1.1" 200 None
2026-03-24 22:59:29 [ayvens.be] INFO: Scrape type for 1973288: 0
2026-03-24 22:59:29 [ayvens.be] INFO: Found listing with ID: 1973289
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973289%27 HTTP/1.1" 200 None
2026-03-24 22:59:29 [ayvens.be] INFO: Scrape type for 1973289: 2
2026-03-24 22:59:29 [ayvens.be] INFO: Extracting data for car ID: 1973289
2026-03-24 22:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33ea888f-ec72-53e0-8d71-e6ee88d99be2 with identifier: 1973289
2026-03-24 22:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33ea888f-ec72-53e0-8d71-e6ee88d99be2 with scrape type 2
2026-03-24 22:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33ea888f-ec72-53e0-8d71-e6ee88d99be2 with scrape type 2
2026-03-24 22:59:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33ea888f-ec72-53e0-8d71-e6ee88d99be2, identifier: 1973289
2026-03-24 22:59:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33ea888f-ec72-53e0-8d71-e6ee88d99be2 with identifier: 1973289
2026-03-24 22:59:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33ea888f-ec72-53e0-8d71-e6ee88d99be2 with identifier: 1973289
2026-03-24 22:59:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33ea888f-ec72-53e0-8d71-e6ee88d99be2 with identifier: 1973289 to the API
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '33ea888f-ec72-53e0-8d71-e6ee88d99be2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 69523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973289%27 HTTP/1.1" 200 None
2026-03-24 22:59:30 [ayvens.be] INFO: Saving data for 1973289: {'auction_closing_time': 1774436400.0, 'created_time': 1774003529.4973, 'last_price_update_time': 1774393170.070294}
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973289') HTTP/1.1" 204 0
2026-03-24 22:59:30 [ayvens.be] INFO: Found listing with ID: 1973290
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973290%27 HTTP/1.1" 200 None
2026-03-24 22:59:30 [ayvens.be] INFO: Scrape type for 1973290: 2
2026-03-24 22:59:30 [ayvens.be] INFO: Extracting data for car ID: 1973290
2026-03-24 22:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97e315eb-20a4-56d4-882d-c63647704fff with identifier: 1973290
2026-03-24 22:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e315eb-20a4-56d4-882d-c63647704fff with scrape type 2
2026-03-24 22:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97e315eb-20a4-56d4-882d-c63647704fff with scrape type 2
2026-03-24 22:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 97e315eb-20a4-56d4-882d-c63647704fff, identifier: 1973290
2026-03-24 22:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 97e315eb-20a4-56d4-882d-c63647704fff with identifier: 1973290
2026-03-24 22:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 97e315eb-20a4-56d4-882d-c63647704fff with identifier: 1973290
2026-03-24 22:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 97e315eb-20a4-56d4-882d-c63647704fff with identifier: 1973290 to the API
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '97e315eb-20a4-56d4-882d-c63647704fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 71509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973290%27 HTTP/1.1" 200 None
2026-03-24 22:59:30 [ayvens.be] INFO: Saving data for 1973290: {'auction_closing_time': 1774436400.0, 'created_time': 1774003549.008042, 'last_price_update_time': 1774393170.439484}
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973290') HTTP/1.1" 204 0
2026-03-24 22:59:30 [ayvens.be] INFO: Found listing with ID: 1973291
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973291%27 HTTP/1.1" 200 None
2026-03-24 22:59:30 [ayvens.be] INFO: Scrape type for 1973291: 2
2026-03-24 22:59:30 [ayvens.be] INFO: Extracting data for car ID: 1973291
2026-03-24 22:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c4456b0-d888-5742-920b-82ceef828305 with identifier: 1973291
2026-03-24 22:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c4456b0-d888-5742-920b-82ceef828305 with scrape type 2
2026-03-24 22:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c4456b0-d888-5742-920b-82ceef828305 with scrape type 2
2026-03-24 22:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9c4456b0-d888-5742-920b-82ceef828305, identifier: 1973291
2026-03-24 22:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9c4456b0-d888-5742-920b-82ceef828305 with identifier: 1973291
2026-03-24 22:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9c4456b0-d888-5742-920b-82ceef828305 with identifier: 1973291
2026-03-24 22:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9c4456b0-d888-5742-920b-82ceef828305 with identifier: 1973291 to the API
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9c4456b0-d888-5742-920b-82ceef828305',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'JUMPY',
 'odometer': 51723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N JUMPY 1.5 BLUEHDI 75KW S-S XL CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S XL CONTROL',
 'vin': None,
 'year': 2020}
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973291%27 HTTP/1.1" 200 None
2026-03-24 22:59:30 [ayvens.be] INFO: Saving data for 1973291: {'auction_closing_time': 1774436400.0, 'created_time': 1774003547.990584, 'last_price_update_time': 1774393170.825063}
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973291') HTTP/1.1" 204 0
2026-03-24 22:59:30 [ayvens.be] INFO: Found listing with ID: 1973292
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973292%27 HTTP/1.1" 200 None
2026-03-24 22:59:30 [ayvens.be] INFO: Scrape type for 1973292: 2
2026-03-24 22:59:30 [ayvens.be] INFO: Extracting data for car ID: 1973292
2026-03-24 22:59:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ea013f-70b4-5b19-89cd-347303b90006 with identifier: 1973292
2026-03-24 22:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ea013f-70b4-5b19-89cd-347303b90006 with scrape type 2
2026-03-24 22:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ea013f-70b4-5b19-89cd-347303b90006 with scrape type 2
2026-03-24 22:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7ea013f-70b4-5b19-89cd-347303b90006, identifier: 1973292
2026-03-24 22:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7ea013f-70b4-5b19-89cd-347303b90006 with identifier: 1973292
2026-03-24 22:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7ea013f-70b4-5b19-89cd-347303b90006 with identifier: 1973292
2026-03-24 22:59:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7ea013f-70b4-5b19-89cd-347303b90006 with identifier: 1973292 to the API
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b7ea013f-70b4-5b19-89cd-347303b90006',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 30002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973292%27 HTTP/1.1" 200 None
2026-03-24 22:59:31 [ayvens.be] INFO: Saving data for 1973292: {'auction_closing_time': 1774436400.0, 'created_time': 1774003533.454282, 'last_price_update_time': 1774393171.518734}
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973292') HTTP/1.1" 204 0
2026-03-24 22:59:31 [ayvens.be] INFO: Found listing with ID: 1973293
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973293%27 HTTP/1.1" 200 None
2026-03-24 22:59:31 [ayvens.be] INFO: Scrape type for 1973293: 2
2026-03-24 22:59:31 [ayvens.be] INFO: Extracting data for car ID: 1973293
2026-03-24 22:59:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff06828a-4b86-5a7a-a99e-d0591d570c04 with identifier: 1973293
2026-03-24 22:59:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff06828a-4b86-5a7a-a99e-d0591d570c04 with scrape type 2
2026-03-24 22:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff06828a-4b86-5a7a-a99e-d0591d570c04 with scrape type 2
2026-03-24 22:59:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ff06828a-4b86-5a7a-a99e-d0591d570c04, identifier: 1973293
2026-03-24 22:59:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ff06828a-4b86-5a7a-a99e-d0591d570c04 with identifier: 1973293
2026-03-24 22:59:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ff06828a-4b86-5a7a-a99e-d0591d570c04 with identifier: 1973293
2026-03-24 22:59:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ff06828a-4b86-5a7a-a99e-d0591d570c04 with identifier: 1973293 to the API
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ff06828a-4b86-5a7a-a99e-d0591d570c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 59633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973293%27 HTTP/1.1" 200 None
2026-03-24 22:59:31 [ayvens.be] INFO: Saving data for 1973293: {'auction_closing_time': 1774436400.0, 'created_time': 1774003546.244296, 'last_price_update_time': 1774393171.897907}
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973293') HTTP/1.1" 204 0
2026-03-24 22:59:31 [ayvens.be] INFO: Found listing with ID: 1973294
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973294%27 HTTP/1.1" 200 None
2026-03-24 22:59:31 [ayvens.be] INFO: Scrape type for 1973294: 2
2026-03-24 22:59:31 [ayvens.be] INFO: Extracting data for car ID: 1973294
2026-03-24 22:59:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90654929-569e-5931-bf5c-4d20ba04f76e with identifier: 1973294
2026-03-24 22:59:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90654929-569e-5931-bf5c-4d20ba04f76e with scrape type 2
2026-03-24 22:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90654929-569e-5931-bf5c-4d20ba04f76e with scrape type 2
2026-03-24 22:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 90654929-569e-5931-bf5c-4d20ba04f76e, identifier: 1973294
2026-03-24 22:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 90654929-569e-5931-bf5c-4d20ba04f76e with identifier: 1973294
2026-03-24 22:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 90654929-569e-5931-bf5c-4d20ba04f76e with identifier: 1973294
2026-03-24 22:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 90654929-569e-5931-bf5c-4d20ba04f76e with identifier: 1973294 to the API
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '90654929-569e-5931-bf5c-4d20ba04f76e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 95506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973294%27 HTTP/1.1" 200 None
2026-03-24 22:59:32 [ayvens.be] INFO: Saving data for 1973294: {'auction_closing_time': 1774436400.0, 'created_time': 1774003545.190497, 'last_price_update_time': 1774393172.274789}
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973294') HTTP/1.1" 204 0
2026-03-24 22:59:32 [ayvens.be] INFO: Found listing with ID: 1973295
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973295%27 HTTP/1.1" 200 None
2026-03-24 22:59:32 [ayvens.be] INFO: Scrape type for 1973295: 2
2026-03-24 22:59:32 [ayvens.be] INFO: Extracting data for car ID: 1973295
2026-03-24 22:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da4d6168-9e1f-5552-bdff-4559a7ee87d6 with identifier: 1973295
2026-03-24 22:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da4d6168-9e1f-5552-bdff-4559a7ee87d6 with scrape type 2
2026-03-24 22:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da4d6168-9e1f-5552-bdff-4559a7ee87d6 with scrape type 2
2026-03-24 22:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: da4d6168-9e1f-5552-bdff-4559a7ee87d6, identifier: 1973295
2026-03-24 22:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: da4d6168-9e1f-5552-bdff-4559a7ee87d6 with identifier: 1973295
2026-03-24 22:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: da4d6168-9e1f-5552-bdff-4559a7ee87d6 with identifier: 1973295
2026-03-24 22:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: da4d6168-9e1f-5552-bdff-4559a7ee87d6 with identifier: 1973295 to the API
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'da4d6168-9e1f-5552-bdff-4559a7ee87d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 94123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973295%27 HTTP/1.1" 200 None
2026-03-24 22:59:32 [ayvens.be] INFO: Saving data for 1973295: {'auction_closing_time': 1774436400.0, 'created_time': 1774003543.172211, 'last_price_update_time': 1774393172.666442}
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973295') HTTP/1.1" 204 0
2026-03-24 22:59:32 [ayvens.be] INFO: Found listing with ID: 1973296
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973296%27 HTTP/1.1" 200 None
2026-03-24 22:59:32 [ayvens.be] INFO: Scrape type for 1973296: 2
2026-03-24 22:59:32 [ayvens.be] INFO: Extracting data for car ID: 1973296
2026-03-24 22:59:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c28c102-fb00-57dc-a543-911ca7ecbab3 with identifier: 1973296
2026-03-24 22:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c28c102-fb00-57dc-a543-911ca7ecbab3 with scrape type 2
2026-03-24 22:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c28c102-fb00-57dc-a543-911ca7ecbab3 with scrape type 2
2026-03-24 22:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4c28c102-fb00-57dc-a543-911ca7ecbab3, identifier: 1973296
2026-03-24 22:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4c28c102-fb00-57dc-a543-911ca7ecbab3 with identifier: 1973296
2026-03-24 22:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4c28c102-fb00-57dc-a543-911ca7ecbab3 with identifier: 1973296
2026-03-24 22:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4c28c102-fb00-57dc-a543-911ca7ecbab3 with identifier: 1973296 to the API
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '4c28c102-fb00-57dc-a543-911ca7ecbab3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40840',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 81299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973296%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Saving data for 1973296: {'auction_closing_time': 1774436400.0, 'created_time': 1774003540.496473, 'last_price_update_time': 1774393173.073769}
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973296') HTTP/1.1" 204 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968932
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968932%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968932: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968933
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968933%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968933: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968934
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968934%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968934: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968935
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968935%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968935: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968936
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968936%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968936: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968937
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968937%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968937: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968938
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968938%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968938: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968939
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968939%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968939: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968940
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968940%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968940: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968941
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968941%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968941: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968942
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968942%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968942: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968943
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968943%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968943: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968944
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968944%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968944: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968945
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968945%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968945: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968946
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968946%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968946: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968947
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968947%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968947: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968948
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968948%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968948: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968949
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968949%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968949: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968950
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968950%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968950: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968951
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968951%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968951: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968952
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968952%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968952: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968953
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968953%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968953: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968954
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968954%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968954: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968955
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968955%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968955: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968956
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968956%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968956: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968957
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968957%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968957: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968958
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968958%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968958: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968959
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968959%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968959: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968960
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968960%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968960: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968961
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968961%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968961: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968962
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968962%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968962: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968963
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968963%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968963: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968964
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968964%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968964: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968965
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968965%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968965: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968966
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968966%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968966: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968967
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968967%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968967: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968968
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968968%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968968: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968969
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968969%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968969: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968970
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968970%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968970: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968971
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968971%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968971: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968972
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968972%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968972: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968973
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968973%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968973: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968974
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968974%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968974: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968975
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968975%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968975: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968976
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968976%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968976: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968977
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968977%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968977: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968978
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968978%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968978: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968979
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968979%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968979: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968980
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968980%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968980: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968981
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968981%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968981: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968982
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968982%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968982: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968983
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968983%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968983: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968984
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968984%27 HTTP/1.1" 200 None
2026-03-24 22:59:33 [ayvens.be] INFO: Scrape type for 1968984: 0
2026-03-24 22:59:33 [ayvens.be] INFO: Found listing with ID: 1968985
2026-03-24 22:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968985%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968985: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968986
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968986%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968986: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968987
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968987%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968987: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968988
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968988%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968988: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968989
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968989%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968989: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968990
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968990%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968990: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968991
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968991%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968991: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968992
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968992%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968992: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968993
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968993%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968993: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968994
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968994%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968994: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968995
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968995%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968995: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968996
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968996%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968996: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968997
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968997%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968997: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968998
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968998%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968998: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1968999
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271968999%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1968999: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1969000
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271969000%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1969000: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1969001
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271969001%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1969001: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1969002
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271969002%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1969002: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1969003
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271969003%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1969003: 0
2026-03-24 22:59:34 [ayvens.be] INFO: Found listing with ID: 1972974
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972974%27 HTTP/1.1" 200 None
2026-03-24 22:59:34 [ayvens.be] INFO: Scrape type for 1972974: 2
2026-03-24 22:59:34 [ayvens.be] INFO: Extracting data for car ID: 1972974
2026-03-24 22:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b48ee1aa-398c-5392-9e57-65ce919492bc with identifier: 1972974
2026-03-24 22:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b48ee1aa-398c-5392-9e57-65ce919492bc with scrape type 2
2026-03-24 22:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b48ee1aa-398c-5392-9e57-65ce919492bc with scrape type 2
2026-03-24 22:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b48ee1aa-398c-5392-9e57-65ce919492bc, identifier: 1972974
2026-03-24 22:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b48ee1aa-398c-5392-9e57-65ce919492bc with identifier: 1972974
2026-03-24 22:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b48ee1aa-398c-5392-9e57-65ce919492bc with identifier: 1972974
2026-03-24 22:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b48ee1aa-398c-5392-9e57-65ce919492bc with identifier: 1972974 to the API
2026-03-24 22:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'BANQUISE WHITE GLOSS',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b48ee1aa-398c-5392-9e57-65ce919492bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 187168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO 1.5 BLUEHDI 100 S-S M LIGHT CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 S-S M LIGHT CLUB',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972974%27 HTTP/1.1" 200 None
2026-03-24 22:59:35 [ayvens.be] INFO: Saving data for 1972974: {'auction_closing_time': 1774427400.0, 'created_time': 1774003539.047916, 'last_price_update_time': 1774393175.821202}
2026-03-24 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972974') HTTP/1.1" 204 0
2026-03-24 22:59:35 [ayvens.be] INFO: Found listing with ID: 1972975
2026-03-24 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972975%27 HTTP/1.1" 200 None
2026-03-24 22:59:35 [ayvens.be] INFO: Scrape type for 1972975: 2
2026-03-24 22:59:35 [ayvens.be] INFO: Extracting data for car ID: 1972975
2026-03-24 22:59:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1972975
2026-03-24 22:59:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593c4467-f8bf-57aa-b5f8-b38822117ae8 with scrape type 2
2026-03-24 22:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 593c4467-f8bf-57aa-b5f8-b38822117ae8 with scrape type 2
2026-03-24 22:59:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 593c4467-f8bf-57aa-b5f8-b38822117ae8, identifier: 1972975
2026-03-24 22:59:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1972975
2026-03-24 22:59:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:59:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1972975
2026-03-24 22:59:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 593c4467-f8bf-57aa-b5f8-b38822117ae8 with identifier: 1972975 to the API
2026-03-24 22:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'PYRIT SILVER METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '593c4467-f8bf-57aa-b5f8-b38822117ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE DIESEL',
 'odometer': 158856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE DIESEL 2.0 TDi SCR Platinum DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi SCR Platinum DSG',
 'vin': None,
 'year': 2019}
2026-03-24 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972975%27 HTTP/1.1" 200 None
2026-03-24 22:59:36 [ayvens.be] INFO: Saving data for 1972975: {'auction_closing_time': 1774427400.0, 'created_time': 1774003539.913976, 'last_price_update_time': 1774393176.317061}
2026-03-24 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972975') HTTP/1.1" 204 0
2026-03-24 22:59:36 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 900
2026-03-24 22:59:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 22:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 22:59:38 [ayvens.be] INFO: Found listing with ID: 1972976
2026-03-24 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972976%27 HTTP/1.1" 200 None
2026-03-24 22:59:38 [ayvens.be] INFO: Scrape type for 1972976: 2
2026-03-24 22:59:38 [ayvens.be] INFO: Extracting data for car ID: 1972976
2026-03-24 22:59:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d2afcb-de8d-572b-8861-21edfbeab650 with identifier: 1972976
2026-03-24 22:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d2afcb-de8d-572b-8861-21edfbeab650 with scrape type 2
2026-03-24 22:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68d2afcb-de8d-572b-8861-21edfbeab650 with scrape type 2
2026-03-24 22:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 68d2afcb-de8d-572b-8861-21edfbeab650, identifier: 1972976
2026-03-24 22:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 68d2afcb-de8d-572b-8861-21edfbeab650 with identifier: 1972976
2026-03-24 22:59:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 68d2afcb-de8d-572b-8861-21edfbeab650 with identifier: 1972976
2026-03-24 22:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 68d2afcb-de8d-572b-8861-21edfbeab650 with identifier: 1972976 to the API
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '68d2afcb-de8d-572b-8861-21edfbeab650',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE A DIESEL (W177)',
 'odometer': 127516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE A DIESEL (W177) A 180 d Launch Edition '
          '(EU6d-TEMP)',
 'transmission': 'automatic',
 'trim': 'A 180 d Launch Edition (EU6d-TEMP)',
 'vin': None,
 'year': 2019}
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972976%27 HTTP/1.1" 200 None
2026-03-24 22:59:39 [ayvens.be] INFO: Saving data for 1972976: {'auction_closing_time': 1774427400.0, 'created_time': 1774003542.307604, 'last_price_update_time': 1774393179.339072}
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972976') HTTP/1.1" 204 0
2026-03-24 22:59:39 [ayvens.be] INFO: Found listing with ID: 1972977
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972977%27 HTTP/1.1" 200 None
2026-03-24 22:59:39 [ayvens.be] INFO: Scrape type for 1972977: 2
2026-03-24 22:59:39 [ayvens.be] INFO: Extracting data for car ID: 1972977
2026-03-24 22:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1972977
2026-03-24 22:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with scrape type 2
2026-03-24 22:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with scrape type 2
2026-03-24 22:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b, identifier: 1972977
2026-03-24 22:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1972977
2026-03-24 22:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1972977
2026-03-24 22:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b with identifier: 1972977 to the API
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c63b6144-fe9f-5a8c-b9ff-d3f8ac386a0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI COUNTRYMAN - 2017',
 'odometer': 107928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI COUNTRYMAN - 2017 1.5A Cooper S E ALL4 Plug-In '
          'H.(EU6d-T.)',
 'transmission': 'automatic',
 'trim': '1.5A Cooper S E ALL4 Plug-In H.(EU6d-T.)',
 'vin': None,
 'year': 2019}
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972977%27 HTTP/1.1" 200 None
2026-03-24 22:59:39 [ayvens.be] INFO: Saving data for 1972977: {'auction_closing_time': 1774427400.0, 'created_time': 1774003546.822219, 'last_price_update_time': 1774393179.714332}
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972977') HTTP/1.1" 204 0
2026-03-24 22:59:39 [ayvens.be] INFO: Found listing with ID: 1972978
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972978%27 HTTP/1.1" 200 None
2026-03-24 22:59:39 [ayvens.be] INFO: Scrape type for 1972978: 2
2026-03-24 22:59:39 [ayvens.be] INFO: Extracting data for car ID: 1972978
2026-03-24 22:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1972978
2026-03-24 22:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with scrape type 2
2026-03-24 22:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with scrape type 2
2026-03-24 22:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5, identifier: 1972978
2026-03-24 22:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1972978
2026-03-24 22:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1972978
2026-03-24 22:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5 with identifier: 1972978 to the API
2026-03-24 22:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b60a75c9-f1ff-5ee0-bf2c-7fb6bf2ff6e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA SPORTS TOURER DIESEL',
 'odometer': 89653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA SPORTS TOURER DIESEL 1.5 Turbo D Ultimate',
 'transmission': 'manual',
 'trim': '1.5 Turbo D Ultimate',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972978%27 HTTP/1.1" 200 None
2026-03-24 22:59:40 [ayvens.be] INFO: Saving data for 1972978: {'auction_closing_time': 1774427400.0, 'created_time': 1774003550.137254, 'last_price_update_time': 1774393180.114741}
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972978') HTTP/1.1" 204 0
2026-03-24 22:59:40 [ayvens.be] INFO: Found listing with ID: 1972979
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972979%27 HTTP/1.1" 200 None
2026-03-24 22:59:40 [ayvens.be] INFO: Scrape type for 1972979: 2
2026-03-24 22:59:40 [ayvens.be] INFO: Extracting data for car ID: 1972979
2026-03-24 22:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fc64d38-19dd-54b6-9c3a-1eb4fc3b9e38 with identifier: 1972979
2026-03-24 22:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc64d38-19dd-54b6-9c3a-1eb4fc3b9e38 with scrape type 2
2026-03-24 22:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fc64d38-19dd-54b6-9c3a-1eb4fc3b9e38 with scrape type 2
2026-03-24 22:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fc64d38-19dd-54b6-9c3a-1eb4fc3b9e38, identifier: 1972979
2026-03-24 22:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fc64d38-19dd-54b6-9c3a-1eb4fc3b9e38 with identifier: 1972979
2026-03-24 22:59:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fc64d38-19dd-54b6-9c3a-1eb4fc3b9e38 with identifier: 1972979
2026-03-24 22:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8fc64d38-19dd-54b6-9c3a-1eb4fc3b9e38 with identifier: 1972979 to the API
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'MINERALGRAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8fc64d38-19dd-54b6-9c3a-1eb4fc3b9e38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 47752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972979%27 HTTP/1.1" 200 None
2026-03-24 22:59:40 [ayvens.be] INFO: Saving data for 1972979: {'auction_closing_time': 1774427400.0, 'created_time': 1774003552.29145, 'last_price_update_time': 1774393180.520266}
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972979') HTTP/1.1" 204 0
2026-03-24 22:59:40 [ayvens.be] INFO: Found listing with ID: 1972980
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972980%27 HTTP/1.1" 200 None
2026-03-24 22:59:40 [ayvens.be] INFO: Scrape type for 1972980: 2
2026-03-24 22:59:40 [ayvens.be] INFO: Extracting data for car ID: 1972980
2026-03-24 22:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1ce1908-da9b-5ac6-9ad6-0909c92cdcd3 with identifier: 1972980
2026-03-24 22:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1ce1908-da9b-5ac6-9ad6-0909c92cdcd3 with scrape type 2
2026-03-24 22:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1ce1908-da9b-5ac6-9ad6-0909c92cdcd3 with scrape type 2
2026-03-24 22:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1ce1908-da9b-5ac6-9ad6-0909c92cdcd3, identifier: 1972980
2026-03-24 22:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1ce1908-da9b-5ac6-9ad6-0909c92cdcd3 with identifier: 1972980
2026-03-24 22:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1ce1908-da9b-5ac6-9ad6-0909c92cdcd3 with identifier: 1972980
2026-03-24 22:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1ce1908-da9b-5ac6-9ad6-0909c92cdcd3 with identifier: 1972980 to the API
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'd1ce1908-da9b-5ac6-9ad6-0909c92cdcd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 46937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BEV 50KWH ELECTR. E-208 AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH ELECTR. E-208 AUTO ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972980%27 HTTP/1.1" 200 None
2026-03-24 22:59:40 [ayvens.be] INFO: Saving data for 1972980: {'auction_closing_time': 1774427400.0, 'created_time': 1774003553.215167, 'last_price_update_time': 1774393180.911502}
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972980') HTTP/1.1" 204 0
2026-03-24 22:59:40 [ayvens.be] INFO: Found listing with ID: 1972981
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972981%27 HTTP/1.1" 200 None
2026-03-24 22:59:40 [ayvens.be] INFO: Scrape type for 1972981: 2
2026-03-24 22:59:40 [ayvens.be] INFO: Extracting data for car ID: 1972981
2026-03-24 22:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1972981
2026-03-24 22:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2bb4396-a70a-5221-884b-42a7e82f7a79 with scrape type 2
2026-03-24 22:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2bb4396-a70a-5221-884b-42a7e82f7a79 with scrape type 2
2026-03-24 22:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e2bb4396-a70a-5221-884b-42a7e82f7a79, identifier: 1972981
2026-03-24 22:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1972981
2026-03-24 22:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1972981
2026-03-24 22:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e2bb4396-a70a-5221-884b-42a7e82f7a79 with identifier: 1972981 to the API
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e2bb4396-a70a-5221-884b-42a7e82f7a79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 45610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972981%27 HTTP/1.1" 200 None
2026-03-24 22:59:41 [ayvens.be] INFO: Saving data for 1972981: {'auction_closing_time': 1774427400.0, 'created_time': 1774003556.582616, 'last_price_update_time': 1774393181.301022}
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972981') HTTP/1.1" 204 0
2026-03-24 22:59:41 [ayvens.be] INFO: Found listing with ID: 1972982
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972982%27 HTTP/1.1" 200 None
2026-03-24 22:59:41 [ayvens.be] INFO: Scrape type for 1972982: 2
2026-03-24 22:59:41 [ayvens.be] INFO: Extracting data for car ID: 1972982
2026-03-24 22:59:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1972982
2026-03-24 22:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with scrape type 2
2026-03-24 22:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with scrape type 2
2026-03-24 22:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65, identifier: 1972982
2026-03-24 22:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1972982
2026-03-24 22:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1972982
2026-03-24 22:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65 with identifier: 1972982 to the API
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '0f9f5dcc-c1c5-5742-9c6a-1cae9cd29d65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 BERLINE',
 'odometer': 122437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 BERLINE 1.0 TFSI 30 81KW S LINE',
 'transmission': 'manual',
 'trim': '1.0 TFSI 30 81KW S LINE',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972982%27 HTTP/1.1" 200 None
2026-03-24 22:59:41 [ayvens.be] INFO: Saving data for 1972982: {'auction_closing_time': 1774427400.0, 'created_time': 1774003558.982444, 'last_price_update_time': 1774393181.693383}
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972982') HTTP/1.1" 204 0
2026-03-24 22:59:41 [ayvens.be] INFO: Found listing with ID: 1972983
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972983%27 HTTP/1.1" 200 None
2026-03-24 22:59:41 [ayvens.be] INFO: Scrape type for 1972983: 2
2026-03-24 22:59:41 [ayvens.be] INFO: Extracting data for car ID: 1972983
2026-03-24 22:59:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f522ad-aa8d-55ca-9cd1-cec6bb95f581 with identifier: 1972983
2026-03-24 22:59:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f522ad-aa8d-55ca-9cd1-cec6bb95f581 with scrape type 2
2026-03-24 22:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f522ad-aa8d-55ca-9cd1-cec6bb95f581 with scrape type 2
2026-03-24 22:59:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a4f522ad-aa8d-55ca-9cd1-cec6bb95f581, identifier: 1972983
2026-03-24 22:59:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a4f522ad-aa8d-55ca-9cd1-cec6bb95f581 with identifier: 1972983
2026-03-24 22:59:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a4f522ad-aa8d-55ca-9cd1-cec6bb95f581 with identifier: 1972983
2026-03-24 22:59:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a4f522ad-aa8d-55ca-9cd1-cec6bb95f581 with identifier: 1972983 to the API
2026-03-24 22:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a4f522ad-aa8d-55ca-9cd1-cec6bb95f581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 120527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.0 TSI 81KW CLEVER',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW CLEVER',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972983%27 HTTP/1.1" 200 None
2026-03-24 22:59:42 [ayvens.be] INFO: Saving data for 1972983: {'auction_closing_time': 1774427400.0, 'created_time': 1774003560.169369, 'last_price_update_time': 1774393182.815972}
2026-03-24 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972983') HTTP/1.1" 204 0
2026-03-24 22:59:42 [ayvens.be] INFO: Found listing with ID: 1972984
2026-03-24 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972984%27 HTTP/1.1" 200 None
2026-03-24 22:59:42 [ayvens.be] INFO: Scrape type for 1972984: 2
2026-03-24 22:59:42 [ayvens.be] INFO: Extracting data for car ID: 1972984
2026-03-24 22:59:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1c2efff-f168-5007-a4a1-4761e63b41c0 with identifier: 1972984
2026-03-24 22:59:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1c2efff-f168-5007-a4a1-4761e63b41c0 with scrape type 2
2026-03-24 22:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1c2efff-f168-5007-a4a1-4761e63b41c0 with scrape type 2
2026-03-24 22:59:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1c2efff-f168-5007-a4a1-4761e63b41c0, identifier: 1972984
2026-03-24 22:59:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1c2efff-f168-5007-a4a1-4761e63b41c0 with identifier: 1972984
2026-03-24 22:59:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:59:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1c2efff-f168-5007-a4a1-4761e63b41c0 with identifier: 1972984
2026-03-24 22:59:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1c2efff-f168-5007-a4a1-4761e63b41c0 with identifier: 1972984 to the API
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'METALLIC',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e1c2efff-f168-5007-a4a1-4761e63b41c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 23052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 CLA 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972984%27 HTTP/1.1" 200 None
2026-03-24 22:59:43 [ayvens.be] INFO: Saving data for 1972984: {'auction_closing_time': 1774427400.0, 'created_time': 1774003561.208264, 'last_price_update_time': 1774393183.250683}
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972984') HTTP/1.1" 204 0
2026-03-24 22:59:43 [ayvens.be] INFO: Found listing with ID: 1972985
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972985%27 HTTP/1.1" 200 None
2026-03-24 22:59:43 [ayvens.be] INFO: Scrape type for 1972985: 2
2026-03-24 22:59:43 [ayvens.be] INFO: Extracting data for car ID: 1972985
2026-03-24 22:59:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50226087-587c-576a-9536-2512c92ef1c8 with identifier: 1972985
2026-03-24 22:59:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50226087-587c-576a-9536-2512c92ef1c8 with scrape type 2
2026-03-24 22:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50226087-587c-576a-9536-2512c92ef1c8 with scrape type 2
2026-03-24 22:59:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 50226087-587c-576a-9536-2512c92ef1c8, identifier: 1972985
2026-03-24 22:59:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 50226087-587c-576a-9536-2512c92ef1c8 with identifier: 1972985
2026-03-24 22:59:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 50226087-587c-576a-9536-2512c92ef1c8 with identifier: 1972985
2026-03-24 22:59:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 50226087-587c-576a-9536-2512c92ef1c8 with identifier: 1972985 to the API
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '50226087-587c-576a-9536-2512c92ef1c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 89598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER 1.0 TCE 90 ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972985%27 HTTP/1.1" 200 None
2026-03-24 22:59:43 [ayvens.be] INFO: Saving data for 1972985: {'auction_closing_time': 1774427400.0, 'created_time': 1774003562.667125, 'last_price_update_time': 1774393183.630953}
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972985') HTTP/1.1" 204 0
2026-03-24 22:59:43 [ayvens.be] INFO: Found listing with ID: 1972986
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972986%27 HTTP/1.1" 200 None
2026-03-24 22:59:43 [ayvens.be] INFO: Scrape type for 1972986: 2
2026-03-24 22:59:43 [ayvens.be] INFO: Extracting data for car ID: 1972986
2026-03-24 22:59:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1972986
2026-03-24 22:59:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b27c98bc-616f-55c0-892b-d9a4b79cfc05 with scrape type 2
2026-03-24 22:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b27c98bc-616f-55c0-892b-d9a4b79cfc05 with scrape type 2
2026-03-24 22:59:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b27c98bc-616f-55c0-892b-d9a4b79cfc05, identifier: 1972986
2026-03-24 22:59:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1972986
2026-03-24 22:59:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1972986
2026-03-24 22:59:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b27c98bc-616f-55c0-892b-d9a4b79cfc05 with identifier: 1972986 to the API
2026-03-24 22:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'b27c98bc-616f-55c0-892b-d9a4b79cfc05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 147043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972986%27 HTTP/1.1" 200 None
2026-03-24 22:59:44 [ayvens.be] INFO: Saving data for 1972986: {'auction_closing_time': 1774427400.0, 'created_time': 1774003564.364714, 'last_price_update_time': 1774393184.136573}
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972986') HTTP/1.1" 204 0
2026-03-24 22:59:44 [ayvens.be] INFO: Found listing with ID: 1972987
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972987%27 HTTP/1.1" 200 None
2026-03-24 22:59:44 [ayvens.be] INFO: Scrape type for 1972987: 2
2026-03-24 22:59:44 [ayvens.be] INFO: Extracting data for car ID: 1972987
2026-03-24 22:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e350dd52-4caf-5b3e-9e3b-b577b7ae4c1e with identifier: 1972987
2026-03-24 22:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e350dd52-4caf-5b3e-9e3b-b577b7ae4c1e with scrape type 2
2026-03-24 22:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e350dd52-4caf-5b3e-9e3b-b577b7ae4c1e with scrape type 2
2026-03-24 22:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e350dd52-4caf-5b3e-9e3b-b577b7ae4c1e, identifier: 1972987
2026-03-24 22:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e350dd52-4caf-5b3e-9e3b-b577b7ae4c1e with identifier: 1972987
2026-03-24 22:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e350dd52-4caf-5b3e-9e3b-b577b7ae4c1e with identifier: 1972987
2026-03-24 22:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e350dd52-4caf-5b3e-9e3b-b577b7ae4c1e with identifier: 1972987 to the API
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e350dd52-4caf-5b3e-9e3b-b577b7ae4c1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE',
 'odometer': 182086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE 2.0 GLE 350 DE PHEV 4MATIC 4WD BUS SOL',
 'transmission': 'automatic',
 'trim': '2.0 GLE 350 DE PHEV 4MATIC 4WD BUS SOL',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972987%27 HTTP/1.1" 200 None
2026-03-24 22:59:44 [ayvens.be] INFO: Saving data for 1972987: {'auction_closing_time': 1774427400.0, 'created_time': 1774003567.651425, 'last_price_update_time': 1774393184.507662}
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972987') HTTP/1.1" 204 0
2026-03-24 22:59:44 [ayvens.be] INFO: Found listing with ID: 1972988
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972988%27 HTTP/1.1" 200 None
2026-03-24 22:59:44 [ayvens.be] INFO: Scrape type for 1972988: 2
2026-03-24 22:59:44 [ayvens.be] INFO: Extracting data for car ID: 1972988
2026-03-24 22:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c11f0ef-21a2-5397-9a48-7437a578c89e with identifier: 1972988
2026-03-24 22:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c11f0ef-21a2-5397-9a48-7437a578c89e with scrape type 2
2026-03-24 22:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c11f0ef-21a2-5397-9a48-7437a578c89e with scrape type 2
2026-03-24 22:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4c11f0ef-21a2-5397-9a48-7437a578c89e, identifier: 1972988
2026-03-24 22:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4c11f0ef-21a2-5397-9a48-7437a578c89e with identifier: 1972988
2026-03-24 22:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4c11f0ef-21a2-5397-9a48-7437a578c89e with identifier: 1972988
2026-03-24 22:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4c11f0ef-21a2-5397-9a48-7437a578c89e with identifier: 1972988 to the API
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4c11f0ef-21a2-5397-9a48-7437a578c89e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60 - 2018',
 'odometer': 113214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 - 2018 2.0 T6 TE AWD PHEV Momentum Pro',
 'transmission': 'automatic',
 'trim': '2.0 T6 TE AWD PHEV Momentum Pro',
 'vin': None,
 'year': 2020}
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972988%27 HTTP/1.1" 200 None
2026-03-24 22:59:44 [ayvens.be] INFO: Saving data for 1972988: {'auction_closing_time': 1774427400.0, 'created_time': 1774003569.109582, 'last_price_update_time': 1774393184.924537}
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972988') HTTP/1.1" 204 0
2026-03-24 22:59:44 [ayvens.be] INFO: Found listing with ID: 1972989
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972989%27 HTTP/1.1" 200 None
2026-03-24 22:59:44 [ayvens.be] INFO: Scrape type for 1972989: 2
2026-03-24 22:59:44 [ayvens.be] INFO: Extracting data for car ID: 1972989
2026-03-24 22:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 566e046e-5808-5d35-891a-6ef6933c72e4 with identifier: 1972989
2026-03-24 22:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 566e046e-5808-5d35-891a-6ef6933c72e4 with scrape type 2
2026-03-24 22:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 566e046e-5808-5d35-891a-6ef6933c72e4 with scrape type 2
2026-03-24 22:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 566e046e-5808-5d35-891a-6ef6933c72e4, identifier: 1972989
2026-03-24 22:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 566e046e-5808-5d35-891a-6ef6933c72e4 with identifier: 1972989
2026-03-24 22:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 566e046e-5808-5d35-891a-6ef6933c72e4 with identifier: 1972989
2026-03-24 22:59:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 566e046e-5808-5d35-891a-6ef6933c72e4 with identifier: 1972989 to the API
2026-03-24 22:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': '566e046e-5808-5d35-891a-6ef6933c72e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 55749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972989%27 HTTP/1.1" 200 None
2026-03-24 22:59:45 [ayvens.be] INFO: Saving data for 1972989: {'auction_closing_time': 1774427400.0, 'created_time': 1774003570.431026, 'last_price_update_time': 1774393185.333506}
2026-03-24 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972989') HTTP/1.1" 204 0
2026-03-24 22:59:45 [ayvens.be] INFO: Found listing with ID: 1972990
2026-03-24 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972990%27 HTTP/1.1" 200 None
2026-03-24 22:59:45 [ayvens.be] INFO: Scrape type for 1972990: 2
2026-03-24 22:59:45 [ayvens.be] INFO: Extracting data for car ID: 1972990
2026-03-24 22:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8779b589-3f17-553c-9174-ba44585caaa5 with identifier: 1972990
2026-03-24 22:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8779b589-3f17-553c-9174-ba44585caaa5 with scrape type 2
2026-03-24 22:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8779b589-3f17-553c-9174-ba44585caaa5 with scrape type 2
2026-03-24 22:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8779b589-3f17-553c-9174-ba44585caaa5, identifier: 1972990
2026-03-24 22:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8779b589-3f17-553c-9174-ba44585caaa5 with identifier: 1972990
2026-03-24 22:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8779b589-3f17-553c-9174-ba44585caaa5 with identifier: 1972990
2026-03-24 22:59:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8779b589-3f17-553c-9174-ba44585caaa5 with identifier: 1972990 to the API
2026-03-24 22:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '8779b589-3f17-553c-9174-ba44585caaa5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KADJAR DIESEL - 2019',
 'odometer': 122356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KADJAR DIESEL - 2019 1.5 Blue dCi Black Edition EDC',
 'transmission': 'automatic',
 'trim': '1.5 Blue dCi Black Edition EDC',
 'vin': None,
 'year': 2020}
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972990%27 HTTP/1.1" 200 None
2026-03-24 22:59:46 [ayvens.be] INFO: Saving data for 1972990: {'auction_closing_time': 1774427400.0, 'created_time': 1774003572.711116, 'last_price_update_time': 1774393186.349757}
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972990') HTTP/1.1" 204 0
2026-03-24 22:59:46 [ayvens.be] INFO: Found listing with ID: 1972991
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972991%27 HTTP/1.1" 200 None
2026-03-24 22:59:46 [ayvens.be] INFO: Scrape type for 1972991: 2
2026-03-24 22:59:46 [ayvens.be] INFO: Extracting data for car ID: 1972991
2026-03-24 22:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f0ed09e-5291-5813-96ea-9f193f120610 with identifier: 1972991
2026-03-24 22:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f0ed09e-5291-5813-96ea-9f193f120610 with scrape type 2
2026-03-24 22:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f0ed09e-5291-5813-96ea-9f193f120610 with scrape type 2
2026-03-24 22:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4f0ed09e-5291-5813-96ea-9f193f120610, identifier: 1972991
2026-03-24 22:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4f0ed09e-5291-5813-96ea-9f193f120610 with identifier: 1972991
2026-03-24 22:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4f0ed09e-5291-5813-96ea-9f193f120610 with identifier: 1972991
2026-03-24 22:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4f0ed09e-5291-5813-96ea-9f193f120610 with identifier: 1972991 to the API
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4f0ed09e-5291-5813-96ea-9f193f120610',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-MAX',
 'odometer': 165259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD S-MAX 2.5I HEV 140KW AUTO ST-LINE',
 'transmission': 'automatic',
 'trim': '2.5I HEV 140KW AUTO ST-LINE',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972991%27 HTTP/1.1" 200 None
2026-03-24 22:59:46 [ayvens.be] INFO: Saving data for 1972991: {'auction_closing_time': 1774427400.0, 'created_time': 1774003574.038045, 'last_price_update_time': 1774393186.740764}
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972991') HTTP/1.1" 204 0
2026-03-24 22:59:46 [ayvens.be] INFO: Found listing with ID: 1972992
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972992%27 HTTP/1.1" 200 None
2026-03-24 22:59:46 [ayvens.be] INFO: Scrape type for 1972992: 2
2026-03-24 22:59:46 [ayvens.be] INFO: Extracting data for car ID: 1972992
2026-03-24 22:59:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1972992
2026-03-24 22:59:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with scrape type 2
2026-03-24 22:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with scrape type 2
2026-03-24 22:59:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6329b518-a0d7-5100-aa37-31aadb1cd7a5, identifier: 1972992
2026-03-24 22:59:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1972992
2026-03-24 22:59:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1972992
2026-03-24 22:59:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6329b518-a0d7-5100-aa37-31aadb1cd7a5 with identifier: 1972992 to the API
2026-03-24 22:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '6329b518-a0d7-5100-aa37-31aadb1cd7a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 127995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) XDRIVE TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) XDRIVE TOURING',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972992%27 HTTP/1.1" 200 None
2026-03-24 22:59:47 [ayvens.be] INFO: Saving data for 1972992: {'auction_closing_time': 1774427400.0, 'created_time': 1774003576.449384, 'last_price_update_time': 1774393187.117494}
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972992') HTTP/1.1" 204 0
2026-03-24 22:59:47 [ayvens.be] INFO: Found listing with ID: 1972993
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972993%27 HTTP/1.1" 200 None
2026-03-24 22:59:47 [ayvens.be] INFO: Scrape type for 1972993: 2
2026-03-24 22:59:47 [ayvens.be] INFO: Extracting data for car ID: 1972993
2026-03-24 22:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0014141c-33c0-5a15-812f-94990b6dd379 with identifier: 1972993
2026-03-24 22:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0014141c-33c0-5a15-812f-94990b6dd379 with scrape type 2
2026-03-24 22:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0014141c-33c0-5a15-812f-94990b6dd379 with scrape type 2
2026-03-24 22:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0014141c-33c0-5a15-812f-94990b6dd379, identifier: 1972993
2026-03-24 22:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0014141c-33c0-5a15-812f-94990b6dd379 with identifier: 1972993
2026-03-24 22:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0014141c-33c0-5a15-812f-94990b6dd379 with identifier: 1972993
2026-03-24 22:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0014141c-33c0-5a15-812f-94990b6dd379 with identifier: 1972993 to the API
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0014141c-33c0-5a15-812f-94990b6dd379',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON MWB DSL - 2016',
 'odometer': 153796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON MWB DSL - 2016 2.0 BlueHDi L3 Long Premium '
          'S&S',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L3 Long Premium S&S',
 'vin': None,
 'year': 2018}
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972993%27 HTTP/1.1" 200 None
2026-03-24 22:59:47 [ayvens.be] INFO: Saving data for 1972993: {'auction_closing_time': 1774427400.0, 'created_time': 1774003578.155667, 'last_price_update_time': 1774393187.514943}
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972993') HTTP/1.1" 204 0
2026-03-24 22:59:47 [ayvens.be] INFO: Found listing with ID: 1972994
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972994%27 HTTP/1.1" 200 None
2026-03-24 22:59:47 [ayvens.be] INFO: Scrape type for 1972994: 2
2026-03-24 22:59:47 [ayvens.be] INFO: Extracting data for car ID: 1972994
2026-03-24 22:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f254b3ca-e422-5e44-82c4-cdfb0be71f46 with identifier: 1972994
2026-03-24 22:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f254b3ca-e422-5e44-82c4-cdfb0be71f46 with scrape type 2
2026-03-24 22:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f254b3ca-e422-5e44-82c4-cdfb0be71f46 with scrape type 2
2026-03-24 22:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f254b3ca-e422-5e44-82c4-cdfb0be71f46, identifier: 1972994
2026-03-24 22:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f254b3ca-e422-5e44-82c4-cdfb0be71f46 with identifier: 1972994
2026-03-24 22:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f254b3ca-e422-5e44-82c4-cdfb0be71f46 with identifier: 1972994
2026-03-24 22:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f254b3ca-e422-5e44-82c4-cdfb0be71f46 with identifier: 1972994 to the API
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'f254b3ca-e422-5e44-82c4-cdfb0be71f46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 166697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972994%27 HTTP/1.1" 200 None
2026-03-24 22:59:47 [ayvens.be] INFO: Saving data for 1972994: {'auction_closing_time': 1774427400.0, 'created_time': 1774003580.798417, 'last_price_update_time': 1774393187.923534}
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972994') HTTP/1.1" 204 0
2026-03-24 22:59:47 [ayvens.be] INFO: Found listing with ID: 1972995
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972995%27 HTTP/1.1" 200 None
2026-03-24 22:59:47 [ayvens.be] INFO: Scrape type for 1972995: 2
2026-03-24 22:59:47 [ayvens.be] INFO: Extracting data for car ID: 1972995
2026-03-24 22:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d97fdeba-3641-51f8-a2ee-a370d3aac9b4 with identifier: 1972995
2026-03-24 22:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d97fdeba-3641-51f8-a2ee-a370d3aac9b4 with scrape type 2
2026-03-24 22:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d97fdeba-3641-51f8-a2ee-a370d3aac9b4 with scrape type 2
2026-03-24 22:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d97fdeba-3641-51f8-a2ee-a370d3aac9b4, identifier: 1972995
2026-03-24 22:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d97fdeba-3641-51f8-a2ee-a370d3aac9b4 with identifier: 1972995
2026-03-24 22:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d97fdeba-3641-51f8-a2ee-a370d3aac9b4 with identifier: 1972995
2026-03-24 22:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d97fdeba-3641-51f8-a2ee-a370d3aac9b4 with identifier: 1972995 to the API
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'd97fdeba-3641-51f8-a2ee-a370d3aac9b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 85752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972995%27 HTTP/1.1" 200 None
2026-03-24 22:59:48 [ayvens.be] INFO: Saving data for 1972995: {'auction_closing_time': 1774427400.0, 'created_time': 1774003586.61497, 'last_price_update_time': 1774393188.277723}
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972995') HTTP/1.1" 204 0
2026-03-24 22:59:48 [ayvens.be] INFO: Found listing with ID: 1972996
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972996%27 HTTP/1.1" 200 None
2026-03-24 22:59:48 [ayvens.be] INFO: Scrape type for 1972996: 2
2026-03-24 22:59:48 [ayvens.be] INFO: Extracting data for car ID: 1972996
2026-03-24 22:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 394f8a26-851a-5981-a743-bd628108aae5 with identifier: 1972996
2026-03-24 22:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 394f8a26-851a-5981-a743-bd628108aae5 with scrape type 2
2026-03-24 22:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 394f8a26-851a-5981-a743-bd628108aae5 with scrape type 2
2026-03-24 22:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 394f8a26-851a-5981-a743-bd628108aae5, identifier: 1972996
2026-03-24 22:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 394f8a26-851a-5981-a743-bd628108aae5 with identifier: 1972996
2026-03-24 22:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 394f8a26-851a-5981-a743-bd628108aae5 with identifier: 1972996
2026-03-24 22:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 394f8a26-851a-5981-a743-bd628108aae5 with identifier: 1972996 to the API
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '394f8a26-851a-5981-a743-bd628108aae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2017',
 'odometer': 108208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2017 1.5 BlueHDi Active (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972996%27 HTTP/1.1" 200 None
2026-03-24 22:59:48 [ayvens.be] INFO: Saving data for 1972996: {'auction_closing_time': 1774427400.0, 'created_time': 1774003588.463753, 'last_price_update_time': 1774393188.656889}
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972996') HTTP/1.1" 204 0
2026-03-24 22:59:48 [ayvens.be] INFO: Found listing with ID: 1972997
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972997%27 HTTP/1.1" 200 None
2026-03-24 22:59:48 [ayvens.be] INFO: Scrape type for 1972997: 2
2026-03-24 22:59:48 [ayvens.be] INFO: Extracting data for car ID: 1972997
2026-03-24 22:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60dfe53c-7154-55dc-8f60-dfcbac93d1f5 with identifier: 1972997
2026-03-24 22:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60dfe53c-7154-55dc-8f60-dfcbac93d1f5 with scrape type 2
2026-03-24 22:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60dfe53c-7154-55dc-8f60-dfcbac93d1f5 with scrape type 2
2026-03-24 22:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 60dfe53c-7154-55dc-8f60-dfcbac93d1f5, identifier: 1972997
2026-03-24 22:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 60dfe53c-7154-55dc-8f60-dfcbac93d1f5 with identifier: 1972997
2026-03-24 22:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 60dfe53c-7154-55dc-8f60-dfcbac93d1f5 with identifier: 1972997
2026-03-24 22:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 60dfe53c-7154-55dc-8f60-dfcbac93d1f5 with identifier: 1972997 to the API
2026-03-24 22:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '60dfe53c-7154-55dc-8f60-dfcbac93d1f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 76602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM CORE',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM CORE',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972997%27 HTTP/1.1" 200 None
2026-03-24 22:59:49 [ayvens.be] INFO: Saving data for 1972997: {'auction_closing_time': 1774427400.0, 'created_time': 1774003589.562983, 'last_price_update_time': 1774393189.118237}
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972997') HTTP/1.1" 204 0
2026-03-24 22:59:49 [ayvens.be] INFO: Found listing with ID: 1972998
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972998%27 HTTP/1.1" 200 None
2026-03-24 22:59:49 [ayvens.be] INFO: Scrape type for 1972998: 2
2026-03-24 22:59:49 [ayvens.be] INFO: Extracting data for car ID: 1972998
2026-03-24 22:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5965ff3f-78bd-55ec-8487-42ba279f794f with identifier: 1972998
2026-03-24 22:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5965ff3f-78bd-55ec-8487-42ba279f794f with scrape type 2
2026-03-24 22:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5965ff3f-78bd-55ec-8487-42ba279f794f with scrape type 2
2026-03-24 22:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5965ff3f-78bd-55ec-8487-42ba279f794f, identifier: 1972998
2026-03-24 22:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5965ff3f-78bd-55ec-8487-42ba279f794f with identifier: 1972998
2026-03-24 22:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5965ff3f-78bd-55ec-8487-42ba279f794f with identifier: 1972998
2026-03-24 22:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5965ff3f-78bd-55ec-8487-42ba279f794f with identifier: 1972998 to the API
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '5965ff3f-78bd-55ec-8487-42ba279f794f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 86645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 PureTech PHEV Bus.Lounge S&S',
 'transmission': 'automatic',
 'trim': '1.6 PureTech PHEV Bus.Lounge S&S',
 'vin': None,
 'year': 2020}
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972998%27 HTTP/1.1" 200 None
2026-03-24 22:59:49 [ayvens.be] INFO: Saving data for 1972998: {'auction_closing_time': 1774427400.0, 'created_time': 1774003592.569487, 'last_price_update_time': 1774393189.495812}
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972998') HTTP/1.1" 204 0
2026-03-24 22:59:49 [ayvens.be] INFO: Found listing with ID: 1972999
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972999%27 HTTP/1.1" 200 None
2026-03-24 22:59:49 [ayvens.be] INFO: Scrape type for 1972999: 2
2026-03-24 22:59:49 [ayvens.be] INFO: Extracting data for car ID: 1972999
2026-03-24 22:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1972999
2026-03-24 22:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with scrape type 2
2026-03-24 22:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with scrape type 2
2026-03-24 22:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73, identifier: 1972999
2026-03-24 22:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1972999
2026-03-24 22:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1972999
2026-03-24 22:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8018b6c-8e7a-55a8-81ec-c9ae9c195f73 with identifier: 1972999 to the API
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'a8018b6c-8e7a-55a8-81ec-c9ae9c195f73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 116535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2020}
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271972999%27 HTTP/1.1" 200 None
2026-03-24 22:59:49 [ayvens.be] INFO: Saving data for 1972999: {'auction_closing_time': 1774427400.0, 'created_time': 1774003594.567432, 'last_price_update_time': 1774393189.898192}
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972999') HTTP/1.1" 204 0
2026-03-24 22:59:49 [ayvens.be] INFO: Found listing with ID: 1973000
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973000%27 HTTP/1.1" 200 None
2026-03-24 22:59:49 [ayvens.be] INFO: Scrape type for 1973000: 2
2026-03-24 22:59:49 [ayvens.be] INFO: Extracting data for car ID: 1973000
2026-03-24 22:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fcd314c-a739-52e5-b7df-1f66b3e0a29c with identifier: 1973000
2026-03-24 22:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fcd314c-a739-52e5-b7df-1f66b3e0a29c with scrape type 2
2026-03-24 22:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fcd314c-a739-52e5-b7df-1f66b3e0a29c with scrape type 2
2026-03-24 22:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fcd314c-a739-52e5-b7df-1f66b3e0a29c, identifier: 1973000
2026-03-24 22:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fcd314c-a739-52e5-b7df-1f66b3e0a29c with identifier: 1973000
2026-03-24 22:59:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 22:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fcd314c-a739-52e5-b7df-1f66b3e0a29c with identifier: 1973000
2026-03-24 22:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8fcd314c-a739-52e5-b7df-1f66b3e0a29c with identifier: 1973000 to the API
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'DESERT ISLAND BLUE SPECIALE METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8fcd314c-a739-52e5-b7df-1f66b3e0a29c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 36991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'transmission': 'automatic',
 'trim': '1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973000%27 HTTP/1.1" 200 None
2026-03-24 22:59:50 [ayvens.be] INFO: Saving data for 1973000: {'auction_closing_time': 1774427400.0, 'created_time': 1774003596.044028, 'last_price_update_time': 1774393190.31469}
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973000') HTTP/1.1" 204 0
2026-03-24 22:59:50 [ayvens.be] INFO: Found listing with ID: 1973001
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973001%27 HTTP/1.1" 200 None
2026-03-24 22:59:50 [ayvens.be] INFO: Scrape type for 1973001: 2
2026-03-24 22:59:50 [ayvens.be] INFO: Extracting data for car ID: 1973001
2026-03-24 22:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a37b48ee-d6bd-576f-a617-cb9bd78208f0 with identifier: 1973001
2026-03-24 22:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a37b48ee-d6bd-576f-a617-cb9bd78208f0 with scrape type 2
2026-03-24 22:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a37b48ee-d6bd-576f-a617-cb9bd78208f0 with scrape type 2
2026-03-24 22:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a37b48ee-d6bd-576f-a617-cb9bd78208f0, identifier: 1973001
2026-03-24 22:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a37b48ee-d6bd-576f-a617-cb9bd78208f0 with identifier: 1973001
2026-03-24 22:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a37b48ee-d6bd-576f-a617-cb9bd78208f0 with identifier: 1973001
2026-03-24 22:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a37b48ee-d6bd-576f-a617-cb9bd78208f0 with identifier: 1973001 to the API
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a37b48ee-d6bd-576f-a617-cb9bd78208f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 64755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973001%27 HTTP/1.1" 200 None
2026-03-24 22:59:50 [ayvens.be] INFO: Saving data for 1973001: {'auction_closing_time': 1774427400.0, 'created_time': 1774003597.148028, 'last_price_update_time': 1774393190.74057}
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973001') HTTP/1.1" 204 0
2026-03-24 22:59:50 [ayvens.be] INFO: Found listing with ID: 1973002
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973002%27 HTTP/1.1" 200 None
2026-03-24 22:59:50 [ayvens.be] INFO: Scrape type for 1973002: 2
2026-03-24 22:59:50 [ayvens.be] INFO: Extracting data for car ID: 1973002
2026-03-24 22:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1973002
2026-03-24 22:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47ce7439-f723-56a1-9135-28d7ab2700fd with scrape type 2
2026-03-24 22:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47ce7439-f723-56a1-9135-28d7ab2700fd with scrape type 2
2026-03-24 22:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 47ce7439-f723-56a1-9135-28d7ab2700fd, identifier: 1973002
2026-03-24 22:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1973002
2026-03-24 22:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1973002
2026-03-24 22:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 47ce7439-f723-56a1-9135-28d7ab2700fd with identifier: 1973002 to the API
2026-03-24 22:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '47ce7439-f723-56a1-9135-28d7ab2700fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 59999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973002%27 HTTP/1.1" 200 None
2026-03-24 22:59:51 [ayvens.be] INFO: Saving data for 1973002: {'auction_closing_time': 1774427400.0, 'created_time': 1774003599.276845, 'last_price_update_time': 1774393191.141288}
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973002') HTTP/1.1" 204 0
2026-03-24 22:59:51 [ayvens.be] INFO: Found listing with ID: 1973003
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973003%27 HTTP/1.1" 200 None
2026-03-24 22:59:51 [ayvens.be] INFO: Scrape type for 1973003: 2
2026-03-24 22:59:51 [ayvens.be] INFO: Extracting data for car ID: 1973003
2026-03-24 22:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1973003
2026-03-24 22:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with scrape type 2
2026-03-24 22:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with scrape type 2
2026-03-24 22:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec, identifier: 1973003
2026-03-24 22:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1973003
2026-03-24 22:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1973003
2026-03-24 22:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c7b5d90a-9f2f-5747-9d5b-37a0f833ddec with identifier: 1973003 to the API
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c7b5d90a-9f2f-5747-9d5b-37a0f833ddec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 38605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI 81KW LIFE BUSINESS',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE BUSINESS',
 'vin': None,
 'year': 2024}
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973003%27 HTTP/1.1" 200 None
2026-03-24 22:59:51 [ayvens.be] INFO: Saving data for 1973003: {'auction_closing_time': 1774427400.0, 'created_time': 1774003600.433967, 'last_price_update_time': 1774393191.506325}
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973003') HTTP/1.1" 204 0
2026-03-24 22:59:51 [ayvens.be] INFO: Found listing with ID: 1973004
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973004%27 HTTP/1.1" 200 None
2026-03-24 22:59:51 [ayvens.be] INFO: Scrape type for 1973004: 2
2026-03-24 22:59:51 [ayvens.be] INFO: Extracting data for car ID: 1973004
2026-03-24 22:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f13311-fadb-5461-8b2e-614317ada596 with identifier: 1973004
2026-03-24 22:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f13311-fadb-5461-8b2e-614317ada596 with scrape type 2
2026-03-24 22:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f13311-fadb-5461-8b2e-614317ada596 with scrape type 2
2026-03-24 22:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 24f13311-fadb-5461-8b2e-614317ada596, identifier: 1973004
2026-03-24 22:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 24f13311-fadb-5461-8b2e-614317ada596 with identifier: 1973004
2026-03-24 22:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 24f13311-fadb-5461-8b2e-614317ada596 with identifier: 1973004
2026-03-24 22:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 24f13311-fadb-5461-8b2e-614317ada596 with identifier: 1973004 to the API
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '24f13311-fadb-5461-8b2e-614317ada596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 34482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.5 TSI 85KW LIFE BUSINESS',
 'transmission': 'manual',
 'trim': '1.5 TSI 85KW LIFE BUSINESS',
 'vin': None,
 'year': 2024}
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973004%27 HTTP/1.1" 200 None
2026-03-24 22:59:51 [ayvens.be] INFO: Saving data for 1973004: {'auction_closing_time': 1774427400.0, 'created_time': 1774003603.08882, 'last_price_update_time': 1774393191.898527}
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973004') HTTP/1.1" 204 0
2026-03-24 22:59:51 [ayvens.be] INFO: Found listing with ID: 1973005
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973005%27 HTTP/1.1" 200 None
2026-03-24 22:59:51 [ayvens.be] INFO: Scrape type for 1973005: 2
2026-03-24 22:59:51 [ayvens.be] INFO: Extracting data for car ID: 1973005
2026-03-24 22:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c9756f6-ce5f-5617-8bcb-93680796b226 with identifier: 1973005
2026-03-24 22:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c9756f6-ce5f-5617-8bcb-93680796b226 with scrape type 2
2026-03-24 22:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c9756f6-ce5f-5617-8bcb-93680796b226 with scrape type 2
2026-03-24 22:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5c9756f6-ce5f-5617-8bcb-93680796b226, identifier: 1973005
2026-03-24 22:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5c9756f6-ce5f-5617-8bcb-93680796b226 with identifier: 1973005
2026-03-24 22:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5c9756f6-ce5f-5617-8bcb-93680796b226 with identifier: 1973005
2026-03-24 22:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5c9756f6-ce5f-5617-8bcb-93680796b226 with identifier: 1973005 to the API
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': '5c9756f6-ce5f-5617-8bcb-93680796b226',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 148793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 55 kWh Standard Plus',
 'transmission': 'automatic',
 'trim': '55 kWh Standard Plus',
 'vin': None,
 'year': 2020}
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973005%27 HTTP/1.1" 200 None
2026-03-24 22:59:52 [ayvens.be] INFO: Saving data for 1973005: {'auction_closing_time': 1774427400.0, 'created_time': 1774003604.92313, 'last_price_update_time': 1774393192.282486}
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973005') HTTP/1.1" 204 0
2026-03-24 22:59:52 [ayvens.be] INFO: Found listing with ID: 1973006
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973006%27 HTTP/1.1" 200 None
2026-03-24 22:59:52 [ayvens.be] INFO: Scrape type for 1973006: 2
2026-03-24 22:59:52 [ayvens.be] INFO: Extracting data for car ID: 1973006
2026-03-24 22:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65bc30c6-7edb-536a-81ff-6b9c70b35834 with identifier: 1973006
2026-03-24 22:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65bc30c6-7edb-536a-81ff-6b9c70b35834 with scrape type 2
2026-03-24 22:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65bc30c6-7edb-536a-81ff-6b9c70b35834 with scrape type 2
2026-03-24 22:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 65bc30c6-7edb-536a-81ff-6b9c70b35834, identifier: 1973006
2026-03-24 22:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 65bc30c6-7edb-536a-81ff-6b9c70b35834 with identifier: 1973006
2026-03-24 22:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 65bc30c6-7edb-536a-81ff-6b9c70b35834 with identifier: 1973006
2026-03-24 22:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 65bc30c6-7edb-536a-81ff-6b9c70b35834 with identifier: 1973006 to the API
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '65bc30c6-7edb-536a-81ff-6b9c70b35834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 87056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 2.0 314 L1 FWD 3.5T FUNCTIONAL',
 'transmission': 'manual',
 'trim': '2.0 314 L1 FWD 3.5T FUNCTIONAL',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973006%27 HTTP/1.1" 200 None
2026-03-24 22:59:52 [ayvens.be] INFO: Saving data for 1973006: {'auction_closing_time': 1774427400.0, 'created_time': 1774003606.386393, 'last_price_update_time': 1774393192.650987}
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973006') HTTP/1.1" 204 0
2026-03-24 22:59:52 [ayvens.be] INFO: Found listing with ID: 1973007
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973007%27 HTTP/1.1" 200 None
2026-03-24 22:59:52 [ayvens.be] INFO: Scrape type for 1973007: 2
2026-03-24 22:59:52 [ayvens.be] INFO: Extracting data for car ID: 1973007
2026-03-24 22:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03ebdb8c-c334-5c11-9e33-358b21660ba1 with identifier: 1973007
2026-03-24 22:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03ebdb8c-c334-5c11-9e33-358b21660ba1 with scrape type 2
2026-03-24 22:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03ebdb8c-c334-5c11-9e33-358b21660ba1 with scrape type 2
2026-03-24 22:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 03ebdb8c-c334-5c11-9e33-358b21660ba1, identifier: 1973007
2026-03-24 22:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 03ebdb8c-c334-5c11-9e33-358b21660ba1 with identifier: 1973007
2026-03-24 22:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 03ebdb8c-c334-5c11-9e33-358b21660ba1 with identifier: 1973007
2026-03-24 22:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 03ebdb8c-c334-5c11-9e33-358b21660ba1 with identifier: 1973007 to the API
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '03ebdb8c-c334-5c11-9e33-358b21660ba1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 99986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973007%27 HTTP/1.1" 200 None
2026-03-24 22:59:53 [ayvens.be] INFO: Saving data for 1973007: {'auction_closing_time': 1774427400.0, 'created_time': 1774003607.701469, 'last_price_update_time': 1774393193.035584}
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973007') HTTP/1.1" 204 0
2026-03-24 22:59:53 [ayvens.be] INFO: Found listing with ID: 1973008
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973008%27 HTTP/1.1" 200 None
2026-03-24 22:59:53 [ayvens.be] INFO: Scrape type for 1973008: 2
2026-03-24 22:59:53 [ayvens.be] INFO: Extracting data for car ID: 1973008
2026-03-24 22:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bc65dc-ed2d-5b49-9772-0de826f051d0 with identifier: 1973008
2026-03-24 22:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bc65dc-ed2d-5b49-9772-0de826f051d0 with scrape type 2
2026-03-24 22:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0bc65dc-ed2d-5b49-9772-0de826f051d0 with scrape type 2
2026-03-24 22:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a0bc65dc-ed2d-5b49-9772-0de826f051d0, identifier: 1973008
2026-03-24 22:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a0bc65dc-ed2d-5b49-9772-0de826f051d0 with identifier: 1973008
2026-03-24 22:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a0bc65dc-ed2d-5b49-9772-0de826f051d0 with identifier: 1973008
2026-03-24 22:59:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a0bc65dc-ed2d-5b49-9772-0de826f051d0 with identifier: 1973008 to the API
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a0bc65dc-ed2d-5b49-9772-0de826f051d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 146831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973008%27 HTTP/1.1" 200 None
2026-03-24 22:59:53 [ayvens.be] INFO: Saving data for 1973008: {'auction_closing_time': 1774427400.0, 'created_time': 1774003609.890551, 'last_price_update_time': 1774393193.51116}
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973008') HTTP/1.1" 204 0
2026-03-24 22:59:53 [ayvens.be] INFO: Found listing with ID: 1973009
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973009%27 HTTP/1.1" 200 None
2026-03-24 22:59:53 [ayvens.be] INFO: Scrape type for 1973009: 2
2026-03-24 22:59:53 [ayvens.be] INFO: Extracting data for car ID: 1973009
2026-03-24 22:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc25a12-1c4a-5931-93c5-b06b971a02a5 with identifier: 1973009
2026-03-24 22:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc25a12-1c4a-5931-93c5-b06b971a02a5 with scrape type 2
2026-03-24 22:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bc25a12-1c4a-5931-93c5-b06b971a02a5 with scrape type 2
2026-03-24 22:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5bc25a12-1c4a-5931-93c5-b06b971a02a5, identifier: 1973009
2026-03-24 22:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5bc25a12-1c4a-5931-93c5-b06b971a02a5 with identifier: 1973009
2026-03-24 22:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5bc25a12-1c4a-5931-93c5-b06b971a02a5 with identifier: 1973009
2026-03-24 22:59:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5bc25a12-1c4a-5931-93c5-b06b971a02a5 with identifier: 1973009 to the API
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5bc25a12-1c4a-5931-93c5-b06b971a02a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE A DIESEL (W177)',
 'odometer': 94584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE A DIESEL (W177) A 180 d',
 'transmission': 'automatic',
 'trim': 'A 180 d',
 'vin': None,
 'year': 2018}
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973009%27 HTTP/1.1" 200 None
2026-03-24 22:59:53 [ayvens.be] INFO: Saving data for 1973009: {'auction_closing_time': 1774427400.0, 'created_time': 1774003610.699333, 'last_price_update_time': 1774393193.880901}
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973009') HTTP/1.1" 204 0
2026-03-24 22:59:53 [ayvens.be] INFO: Found listing with ID: 1973010
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973010%27 HTTP/1.1" 200 None
2026-03-24 22:59:53 [ayvens.be] INFO: Scrape type for 1973010: 2
2026-03-24 22:59:53 [ayvens.be] INFO: Extracting data for car ID: 1973010
2026-03-24 22:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1973010
2026-03-24 22:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55582b44-2a1a-55ba-8550-803dbcef7bd5 with scrape type 2
2026-03-24 22:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55582b44-2a1a-55ba-8550-803dbcef7bd5 with scrape type 2
2026-03-24 22:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55582b44-2a1a-55ba-8550-803dbcef7bd5, identifier: 1973010
2026-03-24 22:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1973010
2026-03-24 22:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1973010
2026-03-24 22:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55582b44-2a1a-55ba-8550-803dbcef7bd5 with identifier: 1973010 to the API
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': '55582b44-2a1a-55ba-8550-803dbcef7bd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'C40',
 'odometer': 72990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO C40 BEV 69KWH RECHARGE PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 69KWH RECHARGE PLUS',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973010%27 HTTP/1.1" 200 None
2026-03-24 22:59:54 [ayvens.be] INFO: Saving data for 1973010: {'auction_closing_time': 1774427400.0, 'created_time': 1774003611.774214, 'last_price_update_time': 1774393194.266234}
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973010') HTTP/1.1" 204 0
2026-03-24 22:59:54 [ayvens.be] INFO: Found listing with ID: 1973011
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973011%27 HTTP/1.1" 200 None
2026-03-24 22:59:54 [ayvens.be] INFO: Scrape type for 1973011: 2
2026-03-24 22:59:54 [ayvens.be] INFO: Extracting data for car ID: 1973011
2026-03-24 22:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a8b2c0-511e-58da-87e9-9851a74b0322 with identifier: 1973011
2026-03-24 22:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a8b2c0-511e-58da-87e9-9851a74b0322 with scrape type 2
2026-03-24 22:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8a8b2c0-511e-58da-87e9-9851a74b0322 with scrape type 2
2026-03-24 22:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c8a8b2c0-511e-58da-87e9-9851a74b0322, identifier: 1973011
2026-03-24 22:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c8a8b2c0-511e-58da-87e9-9851a74b0322 with identifier: 1973011
2026-03-24 22:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c8a8b2c0-511e-58da-87e9-9851a74b0322 with identifier: 1973011
2026-03-24 22:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c8a8b2c0-511e-58da-87e9-9851a74b0322 with identifier: 1973011 to the API
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'c8a8b2c0-511e-58da-87e9-9851a74b0322',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 118267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973011%27 HTTP/1.1" 200 None
2026-03-24 22:59:54 [ayvens.be] INFO: Saving data for 1973011: {'auction_closing_time': 1774427400.0, 'created_time': 1774003614.825933, 'last_price_update_time': 1774393194.673479}
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973011') HTTP/1.1" 204 0
2026-03-24 22:59:54 [ayvens.be] INFO: Found listing with ID: 1973012
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973012%27 HTTP/1.1" 200 None
2026-03-24 22:59:54 [ayvens.be] INFO: Scrape type for 1973012: 2
2026-03-24 22:59:54 [ayvens.be] INFO: Extracting data for car ID: 1973012
2026-03-24 22:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1973012
2026-03-24 22:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41f97a93-de3c-5513-bb76-4e8deedf18cb with scrape type 2
2026-03-24 22:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41f97a93-de3c-5513-bb76-4e8deedf18cb with scrape type 2
2026-03-24 22:59:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 41f97a93-de3c-5513-bb76-4e8deedf18cb, identifier: 1973012
2026-03-24 22:59:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1973012
2026-03-24 22:59:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1973012
2026-03-24 22:59:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 41f97a93-de3c-5513-bb76-4e8deedf18cb with identifier: 1973012 to the API
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '41f97a93-de3c-5513-bb76-4e8deedf18cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 195502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse 1.5 A 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.5 A 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973012%27 HTTP/1.1" 200 None
2026-03-24 22:59:55 [ayvens.be] INFO: Saving data for 1973012: {'auction_closing_time': 1774427400.0, 'created_time': 1774003616.141852, 'last_price_update_time': 1774393195.084187}
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973012') HTTP/1.1" 204 0
2026-03-24 22:59:55 [ayvens.be] INFO: Found listing with ID: 1973013
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973013%27 HTTP/1.1" 200 None
2026-03-24 22:59:55 [ayvens.be] INFO: Scrape type for 1973013: 2
2026-03-24 22:59:55 [ayvens.be] INFO: Extracting data for car ID: 1973013
2026-03-24 22:59:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2d96b5a-eebd-5a47-9ea9-0aaed0265776 with identifier: 1973013
2026-03-24 22:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2d96b5a-eebd-5a47-9ea9-0aaed0265776 with scrape type 2
2026-03-24 22:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2d96b5a-eebd-5a47-9ea9-0aaed0265776 with scrape type 2
2026-03-24 22:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c2d96b5a-eebd-5a47-9ea9-0aaed0265776, identifier: 1973013
2026-03-24 22:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c2d96b5a-eebd-5a47-9ea9-0aaed0265776 with identifier: 1973013
2026-03-24 22:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c2d96b5a-eebd-5a47-9ea9-0aaed0265776 with identifier: 1973013
2026-03-24 22:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c2d96b5a-eebd-5a47-9ea9-0aaed0265776 with identifier: 1973013 to the API
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c2d96b5a-eebd-5a47-9ea9-0aaed0265776',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 SPORTBACK',
 'odometer': 63585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 SPORTBACK 2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973013%27 HTTP/1.1" 200 None
2026-03-24 22:59:55 [ayvens.be] INFO: Saving data for 1973013: {'auction_closing_time': 1774427400.0, 'created_time': 1774003617.470632, 'last_price_update_time': 1774393195.458015}
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973013') HTTP/1.1" 204 0
2026-03-24 22:59:55 [ayvens.be] INFO: Found listing with ID: 1973014
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973014%27 HTTP/1.1" 200 None
2026-03-24 22:59:55 [ayvens.be] INFO: Scrape type for 1973014: 2
2026-03-24 22:59:55 [ayvens.be] INFO: Extracting data for car ID: 1973014
2026-03-24 22:59:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4d9af3f-e170-5a23-a630-86831c6fa21a with identifier: 1973014
2026-03-24 22:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4d9af3f-e170-5a23-a630-86831c6fa21a with scrape type 2
2026-03-24 22:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4d9af3f-e170-5a23-a630-86831c6fa21a with scrape type 2
2026-03-24 22:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f4d9af3f-e170-5a23-a630-86831c6fa21a, identifier: 1973014
2026-03-24 22:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f4d9af3f-e170-5a23-a630-86831c6fa21a with identifier: 1973014
2026-03-24 22:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f4d9af3f-e170-5a23-a630-86831c6fa21a with identifier: 1973014
2026-03-24 22:59:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f4d9af3f-e170-5a23-a630-86831c6fa21a with identifier: 1973014 to the API
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'f4d9af3f-e170-5a23-a630-86831c6fa21a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-NIRO',
 'odometer': 71609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-NIRO 64 kWh More',
 'transmission': 'automatic',
 'trim': '64 kWh More',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973014%27 HTTP/1.1" 200 None
2026-03-24 22:59:55 [ayvens.be] INFO: Saving data for 1973014: {'auction_closing_time': 1774427400.0, 'created_time': 1774003618.639271, 'last_price_update_time': 1774393195.864071}
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973014') HTTP/1.1" 204 0
2026-03-24 22:59:55 [ayvens.be] INFO: Found listing with ID: 1973015
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973015%27 HTTP/1.1" 200 None
2026-03-24 22:59:55 [ayvens.be] INFO: Scrape type for 1973015: 2
2026-03-24 22:59:55 [ayvens.be] INFO: Extracting data for car ID: 1973015
2026-03-24 22:59:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1973015
2026-03-24 22:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dcfa284-9a34-5515-b429-8748e9d277cc with scrape type 2
2026-03-24 22:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dcfa284-9a34-5515-b429-8748e9d277cc with scrape type 2
2026-03-24 22:59:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2dcfa284-9a34-5515-b429-8748e9d277cc, identifier: 1973015
2026-03-24 22:59:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1973015
2026-03-24 22:59:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1973015
2026-03-24 22:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2dcfa284-9a34-5515-b429-8748e9d277cc with identifier: 1973015 to the API
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2dcfa284-9a34-5515-b429-8748e9d277cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI - 2017',
 'odometer': 109215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI - 2017 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI Ambition',
 'vin': None,
 'year': 2019}
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973015%27 HTTP/1.1" 200 None
2026-03-24 22:59:56 [ayvens.be] INFO: Saving data for 1973015: {'auction_closing_time': 1774427400.0, 'created_time': 1774003620.282498, 'last_price_update_time': 1774393196.239486}
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973015') HTTP/1.1" 204 0
2026-03-24 22:59:56 [ayvens.be] INFO: Found listing with ID: 1973016
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973016%27 HTTP/1.1" 200 None
2026-03-24 22:59:56 [ayvens.be] INFO: Scrape type for 1973016: 2
2026-03-24 22:59:56 [ayvens.be] INFO: Extracting data for car ID: 1973016
2026-03-24 22:59:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1973016
2026-03-24 22:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c with scrape type 2
2026-03-24 22:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb9d0228-9c97-532f-a19b-9fa29c9ae81c with scrape type 2
2026-03-24 22:59:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bb9d0228-9c97-532f-a19b-9fa29c9ae81c, identifier: 1973016
2026-03-24 22:59:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1973016
2026-03-24 22:59:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1973016
2026-03-24 22:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bb9d0228-9c97-532f-a19b-9fa29c9ae81c with identifier: 1973016 to the API
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bb9d0228-9c97-532f-a19b-9fa29c9ae81c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 159427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973016%27 HTTP/1.1" 200 None
2026-03-24 22:59:56 [ayvens.be] INFO: Saving data for 1973016: {'auction_closing_time': 1774427400.0, 'created_time': 1774003621.736621, 'last_price_update_time': 1774393196.622752}
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973016') HTTP/1.1" 204 0
2026-03-24 22:59:56 [ayvens.be] INFO: Found listing with ID: 1973017
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973017%27 HTTP/1.1" 200 None
2026-03-24 22:59:56 [ayvens.be] INFO: Scrape type for 1973017: 2
2026-03-24 22:59:56 [ayvens.be] INFO: Extracting data for car ID: 1973017
2026-03-24 22:59:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 272db95d-47fa-571d-8b70-0f9e68b699c9 with identifier: 1973017
2026-03-24 22:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 272db95d-47fa-571d-8b70-0f9e68b699c9 with scrape type 2
2026-03-24 22:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 272db95d-47fa-571d-8b70-0f9e68b699c9 with scrape type 2
2026-03-24 22:59:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 272db95d-47fa-571d-8b70-0f9e68b699c9, identifier: 1973017
2026-03-24 22:59:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 272db95d-47fa-571d-8b70-0f9e68b699c9 with identifier: 1973017
2026-03-24 22:59:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 272db95d-47fa-571d-8b70-0f9e68b699c9 with identifier: 1973017
2026-03-24 22:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 272db95d-47fa-571d-8b70-0f9e68b699c9 with identifier: 1973017 to the API
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '272db95d-47fa-571d-8b70-0f9e68b699c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 111877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ Style plus 1.5 TSI 110 KW 7-SPEED AUTOMAT',
 'transmission': 'automatic',
 'trim': 'Style plus 1.5 TSI 110 KW 7-SPEED AUTOMAT',
 'vin': None,
 'year': 2019}
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973017%27 HTTP/1.1" 200 None
2026-03-24 22:59:57 [ayvens.be] INFO: Saving data for 1973017: {'auction_closing_time': 1774427400.0, 'created_time': 1774003623.808015, 'last_price_update_time': 1774393197.080142}
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973017') HTTP/1.1" 204 0
2026-03-24 22:59:57 [ayvens.be] INFO: Found listing with ID: 1973018
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973018%27 HTTP/1.1" 200 None
2026-03-24 22:59:57 [ayvens.be] INFO: Scrape type for 1973018: 2
2026-03-24 22:59:57 [ayvens.be] INFO: Extracting data for car ID: 1973018
2026-03-24 22:59:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb0fa306-998c-5f5b-9a3a-90955603c2bf with identifier: 1973018
2026-03-24 22:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb0fa306-998c-5f5b-9a3a-90955603c2bf with scrape type 2
2026-03-24 22:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb0fa306-998c-5f5b-9a3a-90955603c2bf with scrape type 2
2026-03-24 22:59:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bb0fa306-998c-5f5b-9a3a-90955603c2bf, identifier: 1973018
2026-03-24 22:59:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bb0fa306-998c-5f5b-9a3a-90955603c2bf with identifier: 1973018
2026-03-24 22:59:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bb0fa306-998c-5f5b-9a3a-90955603c2bf with identifier: 1973018
2026-03-24 22:59:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bb0fa306-998c-5f5b-9a3a-90955603c2bf with identifier: 1973018 to the API
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'bb0fa306-998c-5f5b-9a3a-90955603c2bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 110490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 2.0 TDI 115 XCELLENCE',
 'transmission': 'manual',
 'trim': '2.0 TDI 115 XCELLENCE',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973018%27 HTTP/1.1" 200 None
2026-03-24 22:59:57 [ayvens.be] INFO: Saving data for 1973018: {'auction_closing_time': 1774427400.0, 'created_time': 1774003625.464257, 'last_price_update_time': 1774393197.453175}
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973018') HTTP/1.1" 204 0
2026-03-24 22:59:57 [ayvens.be] INFO: Found listing with ID: 1973019
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973019%27 HTTP/1.1" 200 None
2026-03-24 22:59:57 [ayvens.be] INFO: Scrape type for 1973019: 2
2026-03-24 22:59:57 [ayvens.be] INFO: Extracting data for car ID: 1973019
2026-03-24 22:59:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 833e8104-7a47-56f9-bb95-274d169f86fb with identifier: 1973019
2026-03-24 22:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 833e8104-7a47-56f9-bb95-274d169f86fb with scrape type 2
2026-03-24 22:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 833e8104-7a47-56f9-bb95-274d169f86fb with scrape type 2
2026-03-24 22:59:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 833e8104-7a47-56f9-bb95-274d169f86fb, identifier: 1973019
2026-03-24 22:59:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 833e8104-7a47-56f9-bb95-274d169f86fb with identifier: 1973019
2026-03-24 22:59:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 833e8104-7a47-56f9-bb95-274d169f86fb with identifier: 1973019
2026-03-24 22:59:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 833e8104-7a47-56f9-bb95-274d169f86fb with identifier: 1973019 to the API
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '833e8104-7a47-56f9-bb95-274d169f86fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 160785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 2.0 40 TDI S TRONIC QUATTRO B. E. S LINE',
 'transmission': 'automatic',
 'trim': '2.0 40 TDI S TRONIC QUATTRO B. E. S LINE',
 'vin': None,
 'year': 2022}
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973019%27 HTTP/1.1" 200 None
2026-03-24 22:59:57 [ayvens.be] INFO: Saving data for 1973019: {'auction_closing_time': 1774427400.0, 'created_time': 1774003626.930498, 'last_price_update_time': 1774393197.902322}
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973019') HTTP/1.1" 204 0
2026-03-24 22:59:57 [ayvens.be] INFO: Found listing with ID: 1973020
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973020%27 HTTP/1.1" 200 None
2026-03-24 22:59:57 [ayvens.be] INFO: Scrape type for 1973020: 2
2026-03-24 22:59:57 [ayvens.be] INFO: Extracting data for car ID: 1973020
2026-03-24 22:59:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1f88015-e83f-5164-8618-4c04d3cbc7ad with identifier: 1973020
2026-03-24 22:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1f88015-e83f-5164-8618-4c04d3cbc7ad with scrape type 2
2026-03-24 22:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1f88015-e83f-5164-8618-4c04d3cbc7ad with scrape type 2
2026-03-24 22:59:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c1f88015-e83f-5164-8618-4c04d3cbc7ad, identifier: 1973020
2026-03-24 22:59:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c1f88015-e83f-5164-8618-4c04d3cbc7ad with identifier: 1973020
2026-03-24 22:59:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c1f88015-e83f-5164-8618-4c04d3cbc7ad with identifier: 1973020
2026-03-24 22:59:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c1f88015-e83f-5164-8618-4c04d3cbc7ad with identifier: 1973020 to the API
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c1f88015-e83f-5164-8618-4c04d3cbc7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 124345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973020%27 HTTP/1.1" 200 None
2026-03-24 22:59:58 [ayvens.be] INFO: Saving data for 1973020: {'auction_closing_time': 1774427400.0, 'created_time': 1774003628.458689, 'last_price_update_time': 1774393198.327571}
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973020') HTTP/1.1" 204 0
2026-03-24 22:59:58 [ayvens.be] INFO: Found listing with ID: 1973021
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973021%27 HTTP/1.1" 200 None
2026-03-24 22:59:58 [ayvens.be] INFO: Scrape type for 1973021: 2
2026-03-24 22:59:58 [ayvens.be] INFO: Extracting data for car ID: 1973021
2026-03-24 22:59:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b08ec9e-fe30-5ce5-8a4d-bc289eb58a8f with identifier: 1973021
2026-03-24 22:59:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b08ec9e-fe30-5ce5-8a4d-bc289eb58a8f with scrape type 2
2026-03-24 22:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b08ec9e-fe30-5ce5-8a4d-bc289eb58a8f with scrape type 2
2026-03-24 22:59:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b08ec9e-fe30-5ce5-8a4d-bc289eb58a8f, identifier: 1973021
2026-03-24 22:59:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b08ec9e-fe30-5ce5-8a4d-bc289eb58a8f with identifier: 1973021
2026-03-24 22:59:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b08ec9e-fe30-5ce5-8a4d-bc289eb58a8f with identifier: 1973021
2026-03-24 22:59:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b08ec9e-fe30-5ce5-8a4d-bc289eb58a8f with identifier: 1973021 to the API
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '1b08ec9e-fe30-5ce5-8a4d-bc289eb58a8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 122911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 35 TDI S TRONIC BUS. ED.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS. ED.',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973021%27 HTTP/1.1" 200 None
2026-03-24 22:59:58 [ayvens.be] INFO: Saving data for 1973021: {'auction_closing_time': 1774427400.0, 'created_time': 1774003629.996628, 'last_price_update_time': 1774393198.702957}
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973021') HTTP/1.1" 204 0
2026-03-24 22:59:58 [ayvens.be] INFO: Found listing with ID: 1973022
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973022%27 HTTP/1.1" 200 None
2026-03-24 22:59:58 [ayvens.be] INFO: Scrape type for 1973022: 2
2026-03-24 22:59:58 [ayvens.be] INFO: Extracting data for car ID: 1973022
2026-03-24 22:59:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1973022
2026-03-24 22:59:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 335e1b92-8dec-5058-af43-5393f02dbe77 with scrape type 2
2026-03-24 22:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 335e1b92-8dec-5058-af43-5393f02dbe77 with scrape type 2
2026-03-24 22:59:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 335e1b92-8dec-5058-af43-5393f02dbe77, identifier: 1973022
2026-03-24 22:59:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1973022
2026-03-24 22:59:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1973022
2026-03-24 22:59:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 335e1b92-8dec-5058-af43-5393f02dbe77 with identifier: 1973022 to the API
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '335e1b92-8dec-5058-af43-5393f02dbe77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 103020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973022%27 HTTP/1.1" 200 None
2026-03-24 22:59:59 [ayvens.be] INFO: Saving data for 1973022: {'auction_closing_time': 1774427400.0, 'created_time': 1774003632.196319, 'last_price_update_time': 1774393199.111119}
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973022') HTTP/1.1" 204 0
2026-03-24 22:59:59 [ayvens.be] INFO: Found listing with ID: 1973023
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973023%27 HTTP/1.1" 200 None
2026-03-24 22:59:59 [ayvens.be] INFO: Scrape type for 1973023: 2
2026-03-24 22:59:59 [ayvens.be] INFO: Extracting data for car ID: 1973023
2026-03-24 22:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32e62bfe-50ca-50e4-a50e-3b213a75efcf with identifier: 1973023
2026-03-24 22:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32e62bfe-50ca-50e4-a50e-3b213a75efcf with scrape type 2
2026-03-24 22:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32e62bfe-50ca-50e4-a50e-3b213a75efcf with scrape type 2
2026-03-24 22:59:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 32e62bfe-50ca-50e4-a50e-3b213a75efcf, identifier: 1973023
2026-03-24 22:59:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 32e62bfe-50ca-50e4-a50e-3b213a75efcf with identifier: 1973023
2026-03-24 22:59:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 32e62bfe-50ca-50e4-a50e-3b213a75efcf with identifier: 1973023
2026-03-24 22:59:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 32e62bfe-50ca-50e4-a50e-3b213a75efcf with identifier: 1973023 to the API
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '32e62bfe-50ca-50e4-a50e-3b213a75efcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 GRAN TOURER DIESEL - 2018',
 'odometer': 125348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-02',
 'seats_number': 7,
 'seller_name': None,
 'title': 'BMW 2 GRAN TOURER DIESEL - 2018 216 dA AdBlue',
 'transmission': 'automatic',
 'trim': '216 dA AdBlue',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973023%27 HTTP/1.1" 200 None
2026-03-24 22:59:59 [ayvens.be] INFO: Saving data for 1973023: {'auction_closing_time': 1774427400.0, 'created_time': 1774003633.939182, 'last_price_update_time': 1774393199.525166}
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973023') HTTP/1.1" 204 0
2026-03-24 22:59:59 [ayvens.be] INFO: Found listing with ID: 1973024
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973024%27 HTTP/1.1" 200 None
2026-03-24 22:59:59 [ayvens.be] INFO: Scrape type for 1973024: 2
2026-03-24 22:59:59 [ayvens.be] INFO: Extracting data for car ID: 1973024
2026-03-24 22:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf77c18d-31b0-5f57-99af-1e44a13e297a with identifier: 1973024
2026-03-24 22:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf77c18d-31b0-5f57-99af-1e44a13e297a with scrape type 2
2026-03-24 22:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf77c18d-31b0-5f57-99af-1e44a13e297a with scrape type 2
2026-03-24 22:59:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cf77c18d-31b0-5f57-99af-1e44a13e297a, identifier: 1973024
2026-03-24 22:59:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cf77c18d-31b0-5f57-99af-1e44a13e297a with identifier: 1973024
2026-03-24 22:59:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cf77c18d-31b0-5f57-99af-1e44a13e297a with identifier: 1973024
2026-03-24 22:59:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cf77c18d-31b0-5f57-99af-1e44a13e297a with identifier: 1973024 to the API
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 22:59:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cf77c18d-31b0-5f57-99af-1e44a13e297a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 164855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDI HYBRID MORE',
 'transmission': 'automatic',
 'trim': '1.6 GDI HYBRID MORE',
 'vin': None,
 'year': 2021}
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973024%27 HTTP/1.1" 200 None
2026-03-24 22:59:59 [ayvens.be] INFO: Saving data for 1973024: {'auction_closing_time': 1774427400.0, 'created_time': 1774003635.839707, 'last_price_update_time': 1774393199.897325}
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973024') HTTP/1.1" 204 0
2026-03-24 22:59:59 [ayvens.be] INFO: Found listing with ID: 1973025
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 22:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973025%27 HTTP/1.1" 200 None
2026-03-24 22:59:59 [ayvens.be] INFO: Scrape type for 1973025: 2
2026-03-24 22:59:59 [ayvens.be] INFO: Extracting data for car ID: 1973025
2026-03-24 22:59:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f4410f4-fc84-5513-affd-24fc0a8c5263 with identifier: 1973025
2026-03-24 22:59:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f4410f4-fc84-5513-affd-24fc0a8c5263 with scrape type 2
2026-03-24 22:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f4410f4-fc84-5513-affd-24fc0a8c5263 with scrape type 2
2026-03-24 23:00:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2f4410f4-fc84-5513-affd-24fc0a8c5263, identifier: 1973025
2026-03-24 23:00:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2f4410f4-fc84-5513-affd-24fc0a8c5263 with identifier: 1973025
2026-03-24 23:00:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2f4410f4-fc84-5513-affd-24fc0a8c5263 with identifier: 1973025
2026-03-24 23:00:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2f4410f4-fc84-5513-affd-24fc0a8c5263 with identifier: 1973025 to the API
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2f4410f4-fc84-5513-affd-24fc0a8c5263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 77011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.0 30 TFSI 81KW S LINE',
 'transmission': 'manual',
 'trim': '1.0 30 TFSI 81KW S LINE',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973025%27 HTTP/1.1" 200 None
2026-03-24 23:00:00 [ayvens.be] INFO: Saving data for 1973025: {'auction_closing_time': 1774427400.0, 'created_time': 1774003637.278373, 'last_price_update_time': 1774393200.374712}
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973025') HTTP/1.1" 204 0
2026-03-24 23:00:00 [ayvens.be] INFO: Found listing with ID: 1973026
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973026%27 HTTP/1.1" 200 None
2026-03-24 23:00:00 [ayvens.be] INFO: Scrape type for 1973026: 2
2026-03-24 23:00:00 [ayvens.be] INFO: Extracting data for car ID: 1973026
2026-03-24 23:00:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1973026
2026-03-24 23:00:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0935e4d3-aba0-574f-a79e-8f1945954b6d with scrape type 2
2026-03-24 23:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0935e4d3-aba0-574f-a79e-8f1945954b6d with scrape type 2
2026-03-24 23:00:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0935e4d3-aba0-574f-a79e-8f1945954b6d, identifier: 1973026
2026-03-24 23:00:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1973026
2026-03-24 23:00:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1973026
2026-03-24 23:00:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0935e4d3-aba0-574f-a79e-8f1945954b6d with identifier: 1973026 to the API
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '0935e4d3-aba0-574f-a79e-8f1945954b6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 127120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI 81KW DSG ACTIVE',
 'transmission': 'automatic',
 'trim': '1.0 TSI 81KW DSG ACTIVE',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973026%27 HTTP/1.1" 200 None
2026-03-24 23:00:00 [ayvens.be] INFO: Saving data for 1973026: {'auction_closing_time': 1774427400.0, 'created_time': 1774003638.609093, 'last_price_update_time': 1774393200.847017}
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973026') HTTP/1.1" 204 0
2026-03-24 23:00:00 [ayvens.be] INFO: Found listing with ID: 1973027
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973027%27 HTTP/1.1" 200 None
2026-03-24 23:00:00 [ayvens.be] INFO: Scrape type for 1973027: 2
2026-03-24 23:00:00 [ayvens.be] INFO: Extracting data for car ID: 1973027
2026-03-24 23:00:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664cf525-687c-5e53-9522-ac3beb0e74fb with identifier: 1973027
2026-03-24 23:00:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664cf525-687c-5e53-9522-ac3beb0e74fb with scrape type 2
2026-03-24 23:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 664cf525-687c-5e53-9522-ac3beb0e74fb with scrape type 2
2026-03-24 23:00:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 664cf525-687c-5e53-9522-ac3beb0e74fb, identifier: 1973027
2026-03-24 23:00:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 664cf525-687c-5e53-9522-ac3beb0e74fb with identifier: 1973027
2026-03-24 23:00:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 664cf525-687c-5e53-9522-ac3beb0e74fb with identifier: 1973027
2026-03-24 23:00:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 664cf525-687c-5e53-9522-ac3beb0e74fb with identifier: 1973027 to the API
2026-03-24 23:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '664cf525-687c-5e53-9522-ac3beb0e74fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A1 SPORTBACK',
 'odometer': 40441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A1 SPORTBACK 1.0 25 TFSI S TRONIC ATTRACTION B.E.',
 'transmission': 'automatic',
 'trim': '1.0 25 TFSI S TRONIC ATTRACTION B.E.',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973027%27 HTTP/1.1" 200 None
2026-03-24 23:00:01 [ayvens.be] INFO: Saving data for 1973027: {'auction_closing_time': 1774427400.0, 'created_time': 1774003639.836265, 'last_price_update_time': 1774393201.295719}
2026-03-24 23:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973027') HTTP/1.1" 204 0
2026-03-24 23:00:01 [ayvens.be] INFO: Found listing with ID: 1973028
2026-03-24 23:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973028%27 HTTP/1.1" 200 None
2026-03-24 23:00:01 [ayvens.be] INFO: Scrape type for 1973028: 2
2026-03-24 23:00:01 [ayvens.be] INFO: Extracting data for car ID: 1973028
2026-03-24 23:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1af3867-1408-5f28-94bd-89f5f964cd83 with identifier: 1973028
2026-03-24 23:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1af3867-1408-5f28-94bd-89f5f964cd83 with scrape type 2
2026-03-24 23:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1af3867-1408-5f28-94bd-89f5f964cd83 with scrape type 2
2026-03-24 23:00:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f1af3867-1408-5f28-94bd-89f5f964cd83, identifier: 1973028
2026-03-24 23:00:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f1af3867-1408-5f28-94bd-89f5f964cd83 with identifier: 1973028
2026-03-24 23:00:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f1af3867-1408-5f28-94bd-89f5f964cd83 with identifier: 1973028
2026-03-24 23:00:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f1af3867-1408-5f28-94bd-89f5f964cd83 with identifier: 1973028 to the API
2026-03-24 23:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f1af3867-1408-5f28-94bd-89f5f964cd83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 50479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.0 ETSI DSG LIFE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.0 ETSI DSG LIFE BUSINESS',
 'vin': None,
 'year': 2024}
2026-03-24 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973028%27 HTTP/1.1" 200 None
2026-03-24 23:00:02 [ayvens.be] INFO: Saving data for 1973028: {'auction_closing_time': 1774427400.0, 'created_time': 1774003642.037094, 'last_price_update_time': 1774393202.65873}
2026-03-24 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973028') HTTP/1.1" 204 0
2026-03-24 23:00:02 [ayvens.be] INFO: Found listing with ID: 1973029
2026-03-24 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973029%27 HTTP/1.1" 200 None
2026-03-24 23:00:02 [ayvens.be] INFO: Scrape type for 1973029: 2
2026-03-24 23:00:02 [ayvens.be] INFO: Extracting data for car ID: 1973029
2026-03-24 23:00:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1973029
2026-03-24 23:00:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959ab10b-8f5d-572c-96e3-29bf3d30a140 with scrape type 2
2026-03-24 23:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 959ab10b-8f5d-572c-96e3-29bf3d30a140 with scrape type 2
2026-03-24 23:00:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 959ab10b-8f5d-572c-96e3-29bf3d30a140, identifier: 1973029
2026-03-24 23:00:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1973029
2026-03-24 23:00:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1973029
2026-03-24 23:00:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 959ab10b-8f5d-572c-96e3-29bf3d30a140 with identifier: 1973029 to the API
2026-03-24 23:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '959ab10b-8f5d-572c-96e3-29bf3d30a140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 164549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973029%27 HTTP/1.1" 200 None
2026-03-24 23:00:03 [ayvens.be] INFO: Saving data for 1973029: {'auction_closing_time': 1774427400.0, 'created_time': 1774003643.044557, 'last_price_update_time': 1774393203.069298}
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973029') HTTP/1.1" 204 0
2026-03-24 23:00:03 [ayvens.be] INFO: Found listing with ID: 1973030
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973030%27 HTTP/1.1" 200 None
2026-03-24 23:00:03 [ayvens.be] INFO: Scrape type for 1973030: 2
2026-03-24 23:00:03 [ayvens.be] INFO: Extracting data for car ID: 1973030
2026-03-24 23:00:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 928bd930-2877-5e19-99f8-406b3b8f506b with identifier: 1973030
2026-03-24 23:00:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 928bd930-2877-5e19-99f8-406b3b8f506b with scrape type 2
2026-03-24 23:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 928bd930-2877-5e19-99f8-406b3b8f506b with scrape type 2
2026-03-24 23:00:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 928bd930-2877-5e19-99f8-406b3b8f506b, identifier: 1973030
2026-03-24 23:00:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 928bd930-2877-5e19-99f8-406b3b8f506b with identifier: 1973030
2026-03-24 23:00:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 928bd930-2877-5e19-99f8-406b3b8f506b with identifier: 1973030
2026-03-24 23:00:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 928bd930-2877-5e19-99f8-406b3b8f506b with identifier: 1973030 to the API
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '928bd930-2877-5e19-99f8-406b3b8f506b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Golf',
 'odometer': 88968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Golf 2.0 TDI 85KW LIFE',
 'transmission': 'manual',
 'trim': '2.0 TDI 85KW LIFE',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973030%27 HTTP/1.1" 200 None
2026-03-24 23:00:03 [ayvens.be] INFO: Saving data for 1973030: {'auction_closing_time': 1774427400.0, 'created_time': 1774003645.196389, 'last_price_update_time': 1774393203.576228}
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973030') HTTP/1.1" 204 0
2026-03-24 23:00:03 [ayvens.be] INFO: Found listing with ID: 1973031
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973031%27 HTTP/1.1" 200 None
2026-03-24 23:00:03 [ayvens.be] INFO: Scrape type for 1973031: 2
2026-03-24 23:00:03 [ayvens.be] INFO: Extracting data for car ID: 1973031
2026-03-24 23:00:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c527c17c-0ff8-5541-aa9a-3855083d7e77 with identifier: 1973031
2026-03-24 23:00:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c527c17c-0ff8-5541-aa9a-3855083d7e77 with scrape type 2
2026-03-24 23:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c527c17c-0ff8-5541-aa9a-3855083d7e77 with scrape type 2
2026-03-24 23:00:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c527c17c-0ff8-5541-aa9a-3855083d7e77, identifier: 1973031
2026-03-24 23:00:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c527c17c-0ff8-5541-aa9a-3855083d7e77 with identifier: 1973031
2026-03-24 23:00:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c527c17c-0ff8-5541-aa9a-3855083d7e77 with identifier: 1973031
2026-03-24 23:00:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c527c17c-0ff8-5541-aa9a-3855083d7e77 with identifier: 1973031 to the API
2026-03-24 23:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c527c17c-0ff8-5541-aa9a-3855083d7e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 79286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 2.0 CRTDI 110KW DSG7 STYLE',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 STYLE',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973031%27 HTTP/1.1" 200 None
2026-03-24 23:00:04 [ayvens.be] INFO: Saving data for 1973031: {'auction_closing_time': 1774427400.0, 'created_time': 1774003646.829256, 'last_price_update_time': 1774393204.746773}
2026-03-24 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973031') HTTP/1.1" 204 0
2026-03-24 23:00:04 [ayvens.be] INFO: Found listing with ID: 1973032
2026-03-24 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973032%27 HTTP/1.1" 200 None
2026-03-24 23:00:04 [ayvens.be] INFO: Scrape type for 1973032: 2
2026-03-24 23:00:04 [ayvens.be] INFO: Extracting data for car ID: 1973032
2026-03-24 23:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1973032
2026-03-24 23:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with scrape type 2
2026-03-24 23:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with scrape type 2
2026-03-24 23:00:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e, identifier: 1973032
2026-03-24 23:00:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1973032
2026-03-24 23:00:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1973032
2026-03-24 23:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c93adac2-ee3a-5713-82d6-2c1a80d6ee8e with identifier: 1973032 to the API
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c93adac2-ee3a-5713-82d6-2c1a80d6ee8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 67371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973032%27 HTTP/1.1" 200 None
2026-03-24 23:00:05 [ayvens.be] INFO: Saving data for 1973032: {'auction_closing_time': 1774427400.0, 'created_time': 1774003648.007306, 'last_price_update_time': 1774393205.24578}
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973032') HTTP/1.1" 204 0
2026-03-24 23:00:05 [ayvens.be] INFO: Found listing with ID: 1973033
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973033%27 HTTP/1.1" 200 None
2026-03-24 23:00:05 [ayvens.be] INFO: Scrape type for 1973033: 2
2026-03-24 23:00:05 [ayvens.be] INFO: Extracting data for car ID: 1973033
2026-03-24 23:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5162b974-d9d0-5008-94b3-aa0435ef481e with identifier: 1973033
2026-03-24 23:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5162b974-d9d0-5008-94b3-aa0435ef481e with scrape type 2
2026-03-24 23:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5162b974-d9d0-5008-94b3-aa0435ef481e with scrape type 2
2026-03-24 23:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5162b974-d9d0-5008-94b3-aa0435ef481e, identifier: 1973033
2026-03-24 23:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5162b974-d9d0-5008-94b3-aa0435ef481e with identifier: 1973033
2026-03-24 23:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5162b974-d9d0-5008-94b3-aa0435ef481e with identifier: 1973033
2026-03-24 23:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5162b974-d9d0-5008-94b3-aa0435ef481e with identifier: 1973033 to the API
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5162b974-d9d0-5008-94b3-aa0435ef481e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA - Klasse',
 'odometer': 134034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA - Klasse 2.0 GLA 200 D DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLA 200 D DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973033%27 HTTP/1.1" 200 None
2026-03-24 23:00:05 [ayvens.be] INFO: Saving data for 1973033: {'auction_closing_time': 1774427400.0, 'created_time': 1774003649.769138, 'last_price_update_time': 1774393205.741699}
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973033') HTTP/1.1" 204 0
2026-03-24 23:00:05 [ayvens.be] INFO: Found listing with ID: 1973034
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973034%27 HTTP/1.1" 200 None
2026-03-24 23:00:05 [ayvens.be] INFO: Scrape type for 1973034: 2
2026-03-24 23:00:05 [ayvens.be] INFO: Extracting data for car ID: 1973034
2026-03-24 23:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f826e6c7-efec-5997-890f-ae3846d55e30 with identifier: 1973034
2026-03-24 23:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f826e6c7-efec-5997-890f-ae3846d55e30 with scrape type 2
2026-03-24 23:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f826e6c7-efec-5997-890f-ae3846d55e30 with scrape type 2
2026-03-24 23:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f826e6c7-efec-5997-890f-ae3846d55e30, identifier: 1973034
2026-03-24 23:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f826e6c7-efec-5997-890f-ae3846d55e30 with identifier: 1973034
2026-03-24 23:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f826e6c7-efec-5997-890f-ae3846d55e30 with identifier: 1973034
2026-03-24 23:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f826e6c7-efec-5997-890f-ae3846d55e30 with identifier: 1973034 to the API
2026-03-24 23:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'f826e6c7-efec-5997-890f-ae3846d55e30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 83778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV 75KWH LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973034%27 HTTP/1.1" 200 None
2026-03-24 23:00:07 [ayvens.be] INFO: Saving data for 1973034: {'auction_closing_time': 1774427400.0, 'created_time': 1774003652.269172, 'last_price_update_time': 1774393207.182565}
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973034') HTTP/1.1" 204 0
2026-03-24 23:00:07 [ayvens.be] INFO: Found listing with ID: 1973035
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973035%27 HTTP/1.1" 200 None
2026-03-24 23:00:07 [ayvens.be] INFO: Scrape type for 1973035: 2
2026-03-24 23:00:07 [ayvens.be] INFO: Extracting data for car ID: 1973035
2026-03-24 23:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8927c89-4f7c-540f-bb78-a397c28a3854 with identifier: 1973035
2026-03-24 23:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8927c89-4f7c-540f-bb78-a397c28a3854 with scrape type 2
2026-03-24 23:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8927c89-4f7c-540f-bb78-a397c28a3854 with scrape type 2
2026-03-24 23:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b8927c89-4f7c-540f-bb78-a397c28a3854, identifier: 1973035
2026-03-24 23:00:07 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 0 pages/min), scraped 665 items (at 76 items/min)
2026-03-24 23:00:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-24 23:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b8927c89-4f7c-540f-bb78-a397c28a3854 with identifier: 1973035
2026-03-24 23:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b8927c89-4f7c-540f-bb78-a397c28a3854 with identifier: 1973035
2026-03-24 23:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b8927c89-4f7c-540f-bb78-a397c28a3854 with identifier: 1973035 to the API
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b8927c89-4f7c-540f-bb78-a397c28a3854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 100263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973035%27 HTTP/1.1" 200 None
2026-03-24 23:00:07 [ayvens.be] INFO: Saving data for 1973035: {'auction_closing_time': 1774427400.0, 'created_time': 1774003653.726457, 'last_price_update_time': 1774393207.6137}
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973035') HTTP/1.1" 204 0
2026-03-24 23:00:07 [ayvens.be] INFO: Found listing with ID: 1973036
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973036%27 HTTP/1.1" 200 None
2026-03-24 23:00:07 [ayvens.be] INFO: Scrape type for 1973036: 2
2026-03-24 23:00:07 [ayvens.be] INFO: Extracting data for car ID: 1973036
2026-03-24 23:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9b08504-9f74-5ab4-878b-fb7649cfcda4 with identifier: 1973036
2026-03-24 23:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9b08504-9f74-5ab4-878b-fb7649cfcda4 with scrape type 2
2026-03-24 23:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9b08504-9f74-5ab4-878b-fb7649cfcda4 with scrape type 2
2026-03-24 23:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b9b08504-9f74-5ab4-878b-fb7649cfcda4, identifier: 1973036
2026-03-24 23:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b9b08504-9f74-5ab4-878b-fb7649cfcda4 with identifier: 1973036
2026-03-24 23:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b9b08504-9f74-5ab4-878b-fb7649cfcda4 with identifier: 1973036
2026-03-24 23:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b9b08504-9f74-5ab4-878b-fb7649cfcda4 with identifier: 1973036 to the API
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b9b08504-9f74-5ab4-878b-fb7649cfcda4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 86794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973036%27 HTTP/1.1" 200 None
2026-03-24 23:00:08 [ayvens.be] INFO: Saving data for 1973036: {'auction_closing_time': 1774427400.0, 'created_time': 1774003655.676793, 'last_price_update_time': 1774393208.002222}
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973036') HTTP/1.1" 204 0
2026-03-24 23:00:08 [ayvens.be] INFO: Found listing with ID: 1973037
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973037%27 HTTP/1.1" 200 None
2026-03-24 23:00:08 [ayvens.be] INFO: Scrape type for 1973037: 2
2026-03-24 23:00:08 [ayvens.be] INFO: Extracting data for car ID: 1973037
2026-03-24 23:00:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1973037
2026-03-24 23:00:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a826a95-196a-50d9-9c13-656a021883c3 with scrape type 2
2026-03-24 23:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a826a95-196a-50d9-9c13-656a021883c3 with scrape type 2
2026-03-24 23:00:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2a826a95-196a-50d9-9c13-656a021883c3, identifier: 1973037
2026-03-24 23:00:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1973037
2026-03-24 23:00:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1973037
2026-03-24 23:00:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2a826a95-196a-50d9-9c13-656a021883c3 with identifier: 1973037 to the API
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2a826a95-196a-50d9-9c13-656a021883c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 108460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S&S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973037%27 HTTP/1.1" 200 None
2026-03-24 23:00:08 [ayvens.be] INFO: Saving data for 1973037: {'auction_closing_time': 1774427400.0, 'created_time': 1774003659.865223, 'last_price_update_time': 1774393208.405392}
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973037') HTTP/1.1" 204 0
2026-03-24 23:00:08 [ayvens.be] INFO: Found listing with ID: 1973038
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973038%27 HTTP/1.1" 200 None
2026-03-24 23:00:08 [ayvens.be] INFO: Scrape type for 1973038: 2
2026-03-24 23:00:08 [ayvens.be] INFO: Extracting data for car ID: 1973038
2026-03-24 23:00:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53cd74d3-2bb0-544f-bc00-deaff73322d7 with identifier: 1973038
2026-03-24 23:00:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53cd74d3-2bb0-544f-bc00-deaff73322d7 with scrape type 2
2026-03-24 23:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53cd74d3-2bb0-544f-bc00-deaff73322d7 with scrape type 2
2026-03-24 23:00:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 53cd74d3-2bb0-544f-bc00-deaff73322d7, identifier: 1973038
2026-03-24 23:00:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 53cd74d3-2bb0-544f-bc00-deaff73322d7 with identifier: 1973038
2026-03-24 23:00:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 53cd74d3-2bb0-544f-bc00-deaff73322d7 with identifier: 1973038
2026-03-24 23:00:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 53cd74d3-2bb0-544f-bc00-deaff73322d7 with identifier: 1973038 to the API
2026-03-24 23:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '53cd74d3-2bb0-544f-bc00-deaff73322d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 93835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 318DA (110KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 318DA (110KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973038%27 HTTP/1.1" 200 None
2026-03-24 23:00:09 [ayvens.be] INFO: Saving data for 1973038: {'auction_closing_time': 1774427400.0, 'created_time': 1774003660.533648, 'last_price_update_time': 1774393209.544896}
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973038') HTTP/1.1" 204 0
2026-03-24 23:00:09 [ayvens.be] INFO: Found listing with ID: 1973039
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973039%27 HTTP/1.1" 200 None
2026-03-24 23:00:09 [ayvens.be] INFO: Scrape type for 1973039: 2
2026-03-24 23:00:09 [ayvens.be] INFO: Extracting data for car ID: 1973039
2026-03-24 23:00:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9cd5450-d6f6-5495-b0a0-008663d92416 with identifier: 1973039
2026-03-24 23:00:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cd5450-d6f6-5495-b0a0-008663d92416 with scrape type 2
2026-03-24 23:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9cd5450-d6f6-5495-b0a0-008663d92416 with scrape type 2
2026-03-24 23:00:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c9cd5450-d6f6-5495-b0a0-008663d92416, identifier: 1973039
2026-03-24 23:00:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c9cd5450-d6f6-5495-b0a0-008663d92416 with identifier: 1973039
2026-03-24 23:00:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c9cd5450-d6f6-5495-b0a0-008663d92416 with identifier: 1973039
2026-03-24 23:00:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c9cd5450-d6f6-5495-b0a0-008663d92416 with identifier: 1973039 to the API
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c9cd5450-d6f6-5495-b0a0-008663d92416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 43485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973039%27 HTTP/1.1" 200 None
2026-03-24 23:00:09 [ayvens.be] INFO: Saving data for 1973039: {'auction_closing_time': 1774427400.0, 'created_time': 1774003662.272467, 'last_price_update_time': 1774393209.966678}
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973039') HTTP/1.1" 204 0
2026-03-24 23:00:09 [ayvens.be] INFO: Found listing with ID: 1973040
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973040%27 HTTP/1.1" 200 None
2026-03-24 23:00:09 [ayvens.be] INFO: Scrape type for 1973040: 2
2026-03-24 23:00:10 [ayvens.be] INFO: Extracting data for car ID: 1973040
2026-03-24 23:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e800ac2c-1cd9-50b1-a59e-a938fff35911 with identifier: 1973040
2026-03-24 23:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e800ac2c-1cd9-50b1-a59e-a938fff35911 with scrape type 2
2026-03-24 23:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e800ac2c-1cd9-50b1-a59e-a938fff35911 with scrape type 2
2026-03-24 23:00:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e800ac2c-1cd9-50b1-a59e-a938fff35911, identifier: 1973040
2026-03-24 23:00:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e800ac2c-1cd9-50b1-a59e-a938fff35911 with identifier: 1973040
2026-03-24 23:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e800ac2c-1cd9-50b1-a59e-a938fff35911 with identifier: 1973040
2026-03-24 23:00:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e800ac2c-1cd9-50b1-a59e-a938fff35911 with identifier: 1973040 to the API
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e800ac2c-1cd9-50b1-a59e-a938fff35911',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 50946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973040%27 HTTP/1.1" 200 None
2026-03-24 23:00:10 [ayvens.be] INFO: Saving data for 1973040: {'auction_closing_time': 1774427400.0, 'created_time': 1774003664.283491, 'last_price_update_time': 1774393210.335204}
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973040') HTTP/1.1" 204 0
2026-03-24 23:00:10 [ayvens.be] INFO: Found listing with ID: 1973041
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973041%27 HTTP/1.1" 200 None
2026-03-24 23:00:10 [ayvens.be] INFO: Scrape type for 1973041: 2
2026-03-24 23:00:10 [ayvens.be] INFO: Extracting data for car ID: 1973041
2026-03-24 23:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1973041
2026-03-24 23:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d532fdcb-13d5-5c50-9730-da86ec6cb242 with scrape type 2
2026-03-24 23:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d532fdcb-13d5-5c50-9730-da86ec6cb242 with scrape type 2
2026-03-24 23:00:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d532fdcb-13d5-5c50-9730-da86ec6cb242, identifier: 1973041
2026-03-24 23:00:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1973041
2026-03-24 23:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1973041
2026-03-24 23:00:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d532fdcb-13d5-5c50-9730-da86ec6cb242 with identifier: 1973041 to the API
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd532fdcb-13d5-5c50-9730-da86ec6cb242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 60782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973041%27 HTTP/1.1" 200 None
2026-03-24 23:00:10 [ayvens.be] INFO: Saving data for 1973041: {'auction_closing_time': 1774427400.0, 'created_time': 1774003665.69528, 'last_price_update_time': 1774393210.8222}
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973041') HTTP/1.1" 204 0
2026-03-24 23:00:10 [ayvens.be] INFO: Found listing with ID: 1973042
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973042%27 HTTP/1.1" 200 None
2026-03-24 23:00:10 [ayvens.be] INFO: Scrape type for 1973042: 2
2026-03-24 23:00:10 [ayvens.be] INFO: Extracting data for car ID: 1973042
2026-03-24 23:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1973042
2026-03-24 23:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cccef83-c8e9-5e43-a466-86f3038f3493 with scrape type 2
2026-03-24 23:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cccef83-c8e9-5e43-a466-86f3038f3493 with scrape type 2
2026-03-24 23:00:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cccef83-c8e9-5e43-a466-86f3038f3493, identifier: 1973042
2026-03-24 23:00:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1973042
2026-03-24 23:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1973042
2026-03-24 23:00:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0cccef83-c8e9-5e43-a466-86f3038f3493 with identifier: 1973042 to the API
2026-03-24 23:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '0cccef83-c8e9-5e43-a466-86f3038f3493',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 74920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973042%27 HTTP/1.1" 200 None
2026-03-24 23:00:12 [ayvens.be] INFO: Saving data for 1973042: {'auction_closing_time': 1774427400.0, 'created_time': 1774003667.875762, 'last_price_update_time': 1774393212.068355}
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973042') HTTP/1.1" 204 0
2026-03-24 23:00:12 [ayvens.be] INFO: Found listing with ID: 1973043
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973043%27 HTTP/1.1" 200 None
2026-03-24 23:00:12 [ayvens.be] INFO: Scrape type for 1973043: 2
2026-03-24 23:00:12 [ayvens.be] INFO: Extracting data for car ID: 1973043
2026-03-24 23:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46534f09-af55-5d46-9c5b-6a7e7783b960 with identifier: 1973043
2026-03-24 23:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46534f09-af55-5d46-9c5b-6a7e7783b960 with scrape type 2
2026-03-24 23:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46534f09-af55-5d46-9c5b-6a7e7783b960 with scrape type 2
2026-03-24 23:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 46534f09-af55-5d46-9c5b-6a7e7783b960, identifier: 1973043
2026-03-24 23:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 46534f09-af55-5d46-9c5b-6a7e7783b960 with identifier: 1973043
2026-03-24 23:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 46534f09-af55-5d46-9c5b-6a7e7783b960 with identifier: 1973043
2026-03-24 23:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 46534f09-af55-5d46-9c5b-6a7e7783b960 with identifier: 1973043 to the API
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '46534f09-af55-5d46-9c5b-6a7e7783b960',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 88973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.5 BLUEHDI 130 BUSINESS GPS AUTO 105',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 BUSINESS GPS AUTO 105',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973043%27 HTTP/1.1" 200 None
2026-03-24 23:00:12 [ayvens.be] INFO: Saving data for 1973043: {'auction_closing_time': 1774427400.0, 'created_time': 1774003669.832538, 'last_price_update_time': 1774393212.519302}
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973043') HTTP/1.1" 204 0
2026-03-24 23:00:12 [ayvens.be] INFO: Found listing with ID: 1973044
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973044%27 HTTP/1.1" 200 None
2026-03-24 23:00:12 [ayvens.be] INFO: Scrape type for 1973044: 2
2026-03-24 23:00:12 [ayvens.be] INFO: Extracting data for car ID: 1973044
2026-03-24 23:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1973044
2026-03-24 23:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a479119-61e5-5b1a-b329-a6f67a5b7217 with scrape type 2
2026-03-24 23:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a479119-61e5-5b1a-b329-a6f67a5b7217 with scrape type 2
2026-03-24 23:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a479119-61e5-5b1a-b329-a6f67a5b7217, identifier: 1973044
2026-03-24 23:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1973044
2026-03-24 23:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1973044
2026-03-24 23:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a479119-61e5-5b1a-b329-a6f67a5b7217 with identifier: 1973044 to the API
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3a479119-61e5-5b1a-b329-a6f67a5b7217',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 100504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973044%27 HTTP/1.1" 200 None
2026-03-24 23:00:12 [ayvens.be] INFO: Saving data for 1973044: {'auction_closing_time': 1774427400.0, 'created_time': 1774003684.947155, 'last_price_update_time': 1774393212.999368}
2026-03-24 23:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973044') HTTP/1.1" 204 0
2026-03-24 23:00:13 [ayvens.be] INFO: Found listing with ID: 1973045
2026-03-24 23:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973045%27 HTTP/1.1" 200 None
2026-03-24 23:00:13 [ayvens.be] INFO: Scrape type for 1973045: 2
2026-03-24 23:00:13 [ayvens.be] INFO: Extracting data for car ID: 1973045
2026-03-24 23:00:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1973045
2026-03-24 23:00:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a206e3e-7dc8-586a-86ea-5675f49b7965 with scrape type 2
2026-03-24 23:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a206e3e-7dc8-586a-86ea-5675f49b7965 with scrape type 2
2026-03-24 23:00:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a206e3e-7dc8-586a-86ea-5675f49b7965, identifier: 1973045
2026-03-24 23:00:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1973045
2026-03-24 23:00:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1973045
2026-03-24 23:00:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a206e3e-7dc8-586a-86ea-5675f49b7965 with identifier: 1973045 to the API
2026-03-24 23:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8a206e3e-7dc8-586a-86ea-5675f49b7965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 72093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973045%27 HTTP/1.1" 200 None
2026-03-24 23:00:14 [ayvens.be] INFO: Saving data for 1973045: {'auction_closing_time': 1774427400.0, 'created_time': 1774003674.994905, 'last_price_update_time': 1774393214.503387}
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973045') HTTP/1.1" 204 0
2026-03-24 23:00:14 [ayvens.be] INFO: Found listing with ID: 1973046
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973046%27 HTTP/1.1" 200 None
2026-03-24 23:00:14 [ayvens.be] INFO: Scrape type for 1973046: 2
2026-03-24 23:00:14 [ayvens.be] INFO: Extracting data for car ID: 1973046
2026-03-24 23:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 784a2b0a-fedd-5c0f-b431-5b7a783b6467 with identifier: 1973046
2026-03-24 23:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 784a2b0a-fedd-5c0f-b431-5b7a783b6467 with scrape type 2
2026-03-24 23:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 784a2b0a-fedd-5c0f-b431-5b7a783b6467 with scrape type 2
2026-03-24 23:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 784a2b0a-fedd-5c0f-b431-5b7a783b6467, identifier: 1973046
2026-03-24 23:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 784a2b0a-fedd-5c0f-b431-5b7a783b6467 with identifier: 1973046
2026-03-24 23:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 784a2b0a-fedd-5c0f-b431-5b7a783b6467 with identifier: 1973046
2026-03-24 23:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 784a2b0a-fedd-5c0f-b431-5b7a783b6467 with identifier: 1973046 to the API
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '784a2b0a-fedd-5c0f-b431-5b7a783b6467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 77926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A5 2.0 30 TDI S TRONIC BUS. ED.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS. ED.',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973046%27 HTTP/1.1" 200 None
2026-03-24 23:00:14 [ayvens.be] INFO: Saving data for 1973046: {'auction_closing_time': 1774427400.0, 'created_time': 1774003673.621006, 'last_price_update_time': 1774393214.922798}
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973046') HTTP/1.1" 204 0
2026-03-24 23:00:14 [ayvens.be] INFO: Found listing with ID: 1973047
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973047%27 HTTP/1.1" 200 None
2026-03-24 23:00:14 [ayvens.be] INFO: Scrape type for 1973047: 2
2026-03-24 23:00:14 [ayvens.be] INFO: Extracting data for car ID: 1973047
2026-03-24 23:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25f6b070-bd31-5e4d-9112-30e2b8072bdb with identifier: 1973047
2026-03-24 23:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f6b070-bd31-5e4d-9112-30e2b8072bdb with scrape type 2
2026-03-24 23:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25f6b070-bd31-5e4d-9112-30e2b8072bdb with scrape type 2
2026-03-24 23:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 25f6b070-bd31-5e4d-9112-30e2b8072bdb, identifier: 1973047
2026-03-24 23:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 25f6b070-bd31-5e4d-9112-30e2b8072bdb with identifier: 1973047
2026-03-24 23:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 25f6b070-bd31-5e4d-9112-30e2b8072bdb with identifier: 1973047
2026-03-24 23:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 25f6b070-bd31-5e4d-9112-30e2b8072bdb with identifier: 1973047 to the API
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '25f6b070-bd31-5e4d-9112-30e2b8072bdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 117313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 35 TDI S TRONIC BUS.ED. S LINE',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS.ED. S LINE',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973047%27 HTTP/1.1" 200 None
2026-03-24 23:00:15 [ayvens.be] INFO: Saving data for 1973047: {'auction_closing_time': 1774427400.0, 'created_time': 1774003674.365417, 'last_price_update_time': 1774393215.334805}
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973047') HTTP/1.1" 204 0
2026-03-24 23:00:15 [ayvens.be] INFO: Found listing with ID: 1973048
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973048%27 HTTP/1.1" 200 None
2026-03-24 23:00:15 [ayvens.be] INFO: Scrape type for 1973048: 2
2026-03-24 23:00:15 [ayvens.be] INFO: Extracting data for car ID: 1973048
2026-03-24 23:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3d7f29-eace-5067-b9ab-127b96d9ac1e with identifier: 1973048
2026-03-24 23:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3d7f29-eace-5067-b9ab-127b96d9ac1e with scrape type 2
2026-03-24 23:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3d7f29-eace-5067-b9ab-127b96d9ac1e with scrape type 2
2026-03-24 23:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: be3d7f29-eace-5067-b9ab-127b96d9ac1e, identifier: 1973048
2026-03-24 23:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: be3d7f29-eace-5067-b9ab-127b96d9ac1e with identifier: 1973048
2026-03-24 23:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: be3d7f29-eace-5067-b9ab-127b96d9ac1e with identifier: 1973048
2026-03-24 23:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: be3d7f29-eace-5067-b9ab-127b96d9ac1e with identifier: 1973048 to the API
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'be3d7f29-eace-5067-b9ab-127b96d9ac1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'E-GOLF - 2017',
 'odometer': 80366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN E-GOLF - 2017 35.8kWh E-Golf',
 'transmission': 'automatic',
 'trim': '35.8kWh E-Golf',
 'vin': None,
 'year': 2019}
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973048%27 HTTP/1.1" 200 None
2026-03-24 23:00:15 [ayvens.be] INFO: Saving data for 1973048: {'auction_closing_time': 1774427400.0, 'created_time': 1774003680.198735, 'last_price_update_time': 1774393215.72698}
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973048') HTTP/1.1" 204 0
2026-03-24 23:00:15 [ayvens.be] INFO: Found listing with ID: 1973049
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973049%27 HTTP/1.1" 200 None
2026-03-24 23:00:15 [ayvens.be] INFO: Scrape type for 1973049: 2
2026-03-24 23:00:15 [ayvens.be] INFO: Extracting data for car ID: 1973049
2026-03-24 23:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2800da-6315-5f1e-9cfa-477a4b52b9ed with identifier: 1973049
2026-03-24 23:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2800da-6315-5f1e-9cfa-477a4b52b9ed with scrape type 2
2026-03-24 23:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d2800da-6315-5f1e-9cfa-477a4b52b9ed with scrape type 2
2026-03-24 23:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d2800da-6315-5f1e-9cfa-477a4b52b9ed, identifier: 1973049
2026-03-24 23:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d2800da-6315-5f1e-9cfa-477a4b52b9ed with identifier: 1973049
2026-03-24 23:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d2800da-6315-5f1e-9cfa-477a4b52b9ed with identifier: 1973049
2026-03-24 23:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d2800da-6315-5f1e-9cfa-477a4b52b9ed with identifier: 1973049 to the API
2026-03-24 23:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': '7d2800da-6315-5f1e-9cfa-477a4b52b9ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 108471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973049%27 HTTP/1.1" 200 None
2026-03-24 23:00:17 [ayvens.be] INFO: Saving data for 1973049: {'auction_closing_time': 1774427400.0, 'created_time': 1774003677.645608, 'last_price_update_time': 1774393217.10936}
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973049') HTTP/1.1" 204 0
2026-03-24 23:00:17 [ayvens.be] INFO: Found listing with ID: 1973050
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973050%27 HTTP/1.1" 200 None
2026-03-24 23:00:17 [ayvens.be] INFO: Scrape type for 1973050: 2
2026-03-24 23:00:17 [ayvens.be] INFO: Extracting data for car ID: 1973050
2026-03-24 23:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1973050
2026-03-24 23:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with scrape type 2
2026-03-24 23:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with scrape type 2
2026-03-24 23:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94, identifier: 1973050
2026-03-24 23:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1973050
2026-03-24 23:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1973050
2026-03-24 23:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94 with identifier: 1973050 to the API
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b9748a28-f9a5-5325-a9b1-c3ddaa9b2b94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 113990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 1.6 PHEV 225 PERFORMANCE LINE + AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 PERFORMANCE LINE + AUTO',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973050%27 HTTP/1.1" 200 None
2026-03-24 23:00:17 [ayvens.be] INFO: Saving data for 1973050: {'auction_closing_time': 1774427400.0, 'created_time': 1774003678.855298, 'last_price_update_time': 1774393217.53821}
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973050') HTTP/1.1" 204 0
2026-03-24 23:00:17 [ayvens.be] INFO: Found listing with ID: 1973051
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973051%27 HTTP/1.1" 200 None
2026-03-24 23:00:17 [ayvens.be] INFO: Scrape type for 1973051: 2
2026-03-24 23:00:17 [ayvens.be] INFO: Extracting data for car ID: 1973051
2026-03-24 23:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d75f6cf-13c1-561c-9151-d41e0d4e0503 with identifier: 1973051
2026-03-24 23:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d75f6cf-13c1-561c-9151-d41e0d4e0503 with scrape type 2
2026-03-24 23:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d75f6cf-13c1-561c-9151-d41e0d4e0503 with scrape type 2
2026-03-24 23:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d75f6cf-13c1-561c-9151-d41e0d4e0503, identifier: 1973051
2026-03-24 23:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d75f6cf-13c1-561c-9151-d41e0d4e0503 with identifier: 1973051
2026-03-24 23:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d75f6cf-13c1-561c-9151-d41e0d4e0503 with identifier: 1973051
2026-03-24 23:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d75f6cf-13c1-561c-9151-d41e0d4e0503 with identifier: 1973051 to the API
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '9d75f6cf-13c1-561c-9151-d41e0d4e0503',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA DIESEL - 2017',
 'odometer': 54035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA DIESEL - 2017 1.6 CR TDi Ambition',
 'transmission': 'manual',
 'trim': '1.6 CR TDi Ambition',
 'vin': None,
 'year': 2019}
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973051%27 HTTP/1.1" 200 None
2026-03-24 23:00:17 [ayvens.be] INFO: Saving data for 1973051: {'auction_closing_time': 1774427400.0, 'created_time': 1774003681.594378, 'last_price_update_time': 1774393217.922752}
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973051') HTTP/1.1" 204 0
2026-03-24 23:00:18 [ayvens.be] INFO: Found listing with ID: 1973052
2026-03-24 23:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973052%27 HTTP/1.1" 200 None
2026-03-24 23:00:18 [ayvens.be] INFO: Scrape type for 1973052: 2
2026-03-24 23:00:18 [ayvens.be] INFO: Extracting data for car ID: 1973052
2026-03-24 23:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1973052
2026-03-24 23:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd4a740-44f9-552f-baa0-850394236255 with scrape type 2
2026-03-24 23:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfd4a740-44f9-552f-baa0-850394236255 with scrape type 2
2026-03-24 23:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bfd4a740-44f9-552f-baa0-850394236255, identifier: 1973052
2026-03-24 23:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1973052
2026-03-24 23:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1973052
2026-03-24 23:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bfd4a740-44f9-552f-baa0-850394236255 with identifier: 1973052 to the API
2026-03-24 23:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bfd4a740-44f9-552f-baa0-850394236255',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 90730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973052%27 HTTP/1.1" 200 None
2026-03-24 23:00:19 [ayvens.be] INFO: Saving data for 1973052: {'auction_closing_time': 1774427400.0, 'created_time': 1774003685.949467, 'last_price_update_time': 1774393219.397494}
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973052') HTTP/1.1" 204 0
2026-03-24 23:00:19 [ayvens.be] INFO: Found listing with ID: 1973053
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973053%27 HTTP/1.1" 200 None
2026-03-24 23:00:19 [ayvens.be] INFO: Scrape type for 1973053: 2
2026-03-24 23:00:19 [ayvens.be] INFO: Extracting data for car ID: 1973053
2026-03-24 23:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20b1614-47b8-5df6-a2a8-8fd8a25fba37 with identifier: 1973053
2026-03-24 23:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20b1614-47b8-5df6-a2a8-8fd8a25fba37 with scrape type 2
2026-03-24 23:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c20b1614-47b8-5df6-a2a8-8fd8a25fba37 with scrape type 2
2026-03-24 23:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c20b1614-47b8-5df6-a2a8-8fd8a25fba37, identifier: 1973053
2026-03-24 23:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c20b1614-47b8-5df6-a2a8-8fd8a25fba37 with identifier: 1973053
2026-03-24 23:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c20b1614-47b8-5df6-a2a8-8fd8a25fba37 with identifier: 1973053
2026-03-24 23:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c20b1614-47b8-5df6-a2a8-8fd8a25fba37 with identifier: 1973053 to the API
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c20b1614-47b8-5df6-a2a8-8fd8a25fba37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 69543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.0 30 TFSI 81KW S TRONIC BUSINESS EDIT.',
 'transmission': 'automatic',
 'trim': '1.0 30 TFSI 81KW S TRONIC BUSINESS EDIT.',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973053%27 HTTP/1.1" 200 None
2026-03-24 23:00:19 [ayvens.be] INFO: Saving data for 1973053: {'auction_closing_time': 1774427400.0, 'created_time': 1774003686.994456, 'last_price_update_time': 1774393219.799273}
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973053') HTTP/1.1" 204 0
2026-03-24 23:00:19 [ayvens.be] INFO: Found listing with ID: 1973054
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973054%27 HTTP/1.1" 200 None
2026-03-24 23:00:19 [ayvens.be] INFO: Scrape type for 1973054: 2
2026-03-24 23:00:19 [ayvens.be] INFO: Extracting data for car ID: 1973054
2026-03-24 23:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2b360f-9479-51d8-98a4-67e483fe0635 with identifier: 1973054
2026-03-24 23:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2b360f-9479-51d8-98a4-67e483fe0635 with scrape type 2
2026-03-24 23:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab2b360f-9479-51d8-98a4-67e483fe0635 with scrape type 2
2026-03-24 23:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab2b360f-9479-51d8-98a4-67e483fe0635, identifier: 1973054
2026-03-24 23:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab2b360f-9479-51d8-98a4-67e483fe0635 with identifier: 1973054
2026-03-24 23:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab2b360f-9479-51d8-98a4-67e483fe0635 with identifier: 1973054
2026-03-24 23:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ab2b360f-9479-51d8-98a4-67e483fe0635 with identifier: 1973054 to the API
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ab2b360f-9479-51d8-98a4-67e483fe0635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE GRANDTOUR',
 'odometer': 120946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE GRANDTOUR 1.5 BLUE DCI 115 INTENS',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 115 INTENS',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973054%27 HTTP/1.1" 200 None
2026-03-24 23:00:20 [ayvens.be] INFO: Saving data for 1973054: {'auction_closing_time': 1774427400.0, 'created_time': 1774003688.033167, 'last_price_update_time': 1774393220.198174}
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973054') HTTP/1.1" 204 0
2026-03-24 23:00:20 [ayvens.be] INFO: Found listing with ID: 1973055
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973055%27 HTTP/1.1" 200 None
2026-03-24 23:00:20 [ayvens.be] INFO: Scrape type for 1973055: 2
2026-03-24 23:00:20 [ayvens.be] INFO: Extracting data for car ID: 1973055
2026-03-24 23:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf3341ea-0fe2-5134-9788-2f40b1e9d91d with identifier: 1973055
2026-03-24 23:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf3341ea-0fe2-5134-9788-2f40b1e9d91d with scrape type 2
2026-03-24 23:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf3341ea-0fe2-5134-9788-2f40b1e9d91d with scrape type 2
2026-03-24 23:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bf3341ea-0fe2-5134-9788-2f40b1e9d91d, identifier: 1973055
2026-03-24 23:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bf3341ea-0fe2-5134-9788-2f40b1e9d91d with identifier: 1973055
2026-03-24 23:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bf3341ea-0fe2-5134-9788-2f40b1e9d91d with identifier: 1973055
2026-03-24 23:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bf3341ea-0fe2-5134-9788-2f40b1e9d91d with identifier: 1973055 to the API
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bf3341ea-0fe2-5134-9788-2f40b1e9d91d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 21357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW ST-LINE',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW ST-LINE',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973055%27 HTTP/1.1" 200 None
2026-03-24 23:00:20 [ayvens.be] INFO: Saving data for 1973055: {'auction_closing_time': 1774427400.0, 'created_time': 1774003690.454247, 'last_price_update_time': 1774393220.572981}
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973055') HTTP/1.1" 204 0
2026-03-24 23:00:20 [ayvens.be] INFO: Found listing with ID: 1973056
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973056%27 HTTP/1.1" 200 None
2026-03-24 23:00:20 [ayvens.be] INFO: Scrape type for 1973056: 2
2026-03-24 23:00:20 [ayvens.be] INFO: Extracting data for car ID: 1973056
2026-03-24 23:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9aaadf7-4322-514d-8d8f-8c711d73d540 with identifier: 1973056
2026-03-24 23:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9aaadf7-4322-514d-8d8f-8c711d73d540 with scrape type 2
2026-03-24 23:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9aaadf7-4322-514d-8d8f-8c711d73d540 with scrape type 2
2026-03-24 23:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f9aaadf7-4322-514d-8d8f-8c711d73d540, identifier: 1973056
2026-03-24 23:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f9aaadf7-4322-514d-8d8f-8c711d73d540 with identifier: 1973056
2026-03-24 23:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f9aaadf7-4322-514d-8d8f-8c711d73d540 with identifier: 1973056
2026-03-24 23:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f9aaadf7-4322-514d-8d8f-8c711d73d540 with identifier: 1973056 to the API
2026-03-24 23:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f9aaadf7-4322-514d-8d8f-8c711d73d540',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI - 2019',
 'odometer': 78077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI - 2019 1.4 TSI PHEV Style DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV Style DSG',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973056%27 HTTP/1.1" 200 None
2026-03-24 23:00:21 [ayvens.be] INFO: Saving data for 1973056: {'auction_closing_time': 1774427400.0, 'created_time': 1774003692.142501, 'last_price_update_time': 1774393221.954447}
2026-03-24 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973056') HTTP/1.1" 204 0
2026-03-24 23:00:21 [ayvens.be] INFO: Found listing with ID: 1973057
2026-03-24 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973057%27 HTTP/1.1" 200 None
2026-03-24 23:00:21 [ayvens.be] INFO: Scrape type for 1973057: 2
2026-03-24 23:00:21 [ayvens.be] INFO: Extracting data for car ID: 1973057
2026-03-24 23:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1973057
2026-03-24 23:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 581e808f-db3d-59b1-ba12-bd1d1e86e005 with scrape type 2
2026-03-24 23:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 581e808f-db3d-59b1-ba12-bd1d1e86e005 with scrape type 2
2026-03-24 23:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 581e808f-db3d-59b1-ba12-bd1d1e86e005, identifier: 1973057
2026-03-24 23:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1973057
2026-03-24 23:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1973057
2026-03-24 23:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 581e808f-db3d-59b1-ba12-bd1d1e86e005 with identifier: 1973057 to the API
2026-03-24 23:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '581e808f-db3d-59b1-ba12-bd1d1e86e005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 122577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 74KW S-S ALLURE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 74KW S-S ALLURE',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973057%27 HTTP/1.1" 200 None
2026-03-24 23:00:22 [ayvens.be] INFO: Saving data for 1973057: {'auction_closing_time': 1774427400.0, 'created_time': 1774003692.960208, 'last_price_update_time': 1774393222.386964}
2026-03-24 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973057') HTTP/1.1" 204 0
2026-03-24 23:00:22 [ayvens.be] INFO: Found listing with ID: 1973058
2026-03-24 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973058%27 HTTP/1.1" 200 None
2026-03-24 23:00:22 [ayvens.be] INFO: Scrape type for 1973058: 2
2026-03-24 23:00:22 [ayvens.be] INFO: Extracting data for car ID: 1973058
2026-03-24 23:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5a0822c-1e05-57d3-850b-9bde020294db with identifier: 1973058
2026-03-24 23:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a0822c-1e05-57d3-850b-9bde020294db with scrape type 2
2026-03-24 23:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5a0822c-1e05-57d3-850b-9bde020294db with scrape type 2
2026-03-24 23:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f5a0822c-1e05-57d3-850b-9bde020294db, identifier: 1973058
2026-03-24 23:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f5a0822c-1e05-57d3-850b-9bde020294db with identifier: 1973058
2026-03-24 23:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f5a0822c-1e05-57d3-850b-9bde020294db with identifier: 1973058
2026-03-24 23:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f5a0822c-1e05-57d3-850b-9bde020294db with identifier: 1973058 to the API
2026-03-24 23:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f5a0822c-1e05-57d3-850b-9bde020294db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 110225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.6 CRTDI 85KW DSG7 AMBITION',
 'transmission': 'automatic',
 'trim': '1.6 CRTDI 85KW DSG7 AMBITION',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973058%27 HTTP/1.1" 200 None
2026-03-24 23:00:23 [ayvens.be] INFO: Saving data for 1973058: {'auction_closing_time': 1774427400.0, 'created_time': 1774003694.616519, 'last_price_update_time': 1774393223.474983}
2026-03-24 23:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973058') HTTP/1.1" 204 0
2026-03-24 23:00:23 [ayvens.be] INFO: Found listing with ID: 1973059
2026-03-24 23:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973059%27 HTTP/1.1" 200 None
2026-03-24 23:00:23 [ayvens.be] INFO: Scrape type for 1973059: 2
2026-03-24 23:00:23 [ayvens.be] INFO: Extracting data for car ID: 1973059
2026-03-24 23:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a9b41d7-607d-5f8a-ad2e-ba82c47907cd with identifier: 1973059
2026-03-24 23:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9b41d7-607d-5f8a-ad2e-ba82c47907cd with scrape type 2
2026-03-24 23:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a9b41d7-607d-5f8a-ad2e-ba82c47907cd with scrape type 2
2026-03-24 23:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a9b41d7-607d-5f8a-ad2e-ba82c47907cd, identifier: 1973059
2026-03-24 23:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a9b41d7-607d-5f8a-ad2e-ba82c47907cd with identifier: 1973059
2026-03-24 23:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a9b41d7-607d-5f8a-ad2e-ba82c47907cd with identifier: 1973059
2026-03-24 23:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a9b41d7-607d-5f8a-ad2e-ba82c47907cd with identifier: 1973059 to the API
2026-03-24 23:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': '1a9b41d7-607d-5f8a-ad2e-ba82c47907cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 93611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973059%27 HTTP/1.1" 200 None
2026-03-24 23:00:24 [ayvens.be] INFO: Saving data for 1973059: {'auction_closing_time': 1774427400.0, 'created_time': 1774003696.399348, 'last_price_update_time': 1774393224.722872}
2026-03-24 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973059') HTTP/1.1" 204 0
2026-03-24 23:00:24 [ayvens.be] INFO: Found listing with ID: 1973060
2026-03-24 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973060%27 HTTP/1.1" 200 None
2026-03-24 23:00:24 [ayvens.be] INFO: Scrape type for 1973060: 2
2026-03-24 23:00:24 [ayvens.be] INFO: Extracting data for car ID: 1973060
2026-03-24 23:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0700d29-eb4b-5e30-8033-4e6281a528bd with identifier: 1973060
2026-03-24 23:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0700d29-eb4b-5e30-8033-4e6281a528bd with scrape type 2
2026-03-24 23:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0700d29-eb4b-5e30-8033-4e6281a528bd with scrape type 2
2026-03-24 23:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f0700d29-eb4b-5e30-8033-4e6281a528bd, identifier: 1973060
2026-03-24 23:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f0700d29-eb4b-5e30-8033-4e6281a528bd with identifier: 1973060
2026-03-24 23:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f0700d29-eb4b-5e30-8033-4e6281a528bd with identifier: 1973060
2026-03-24 23:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f0700d29-eb4b-5e30-8033-4e6281a528bd with identifier: 1973060 to the API
2026-03-24 23:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f0700d29-eb4b-5e30-8033-4e6281a528bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 172030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI 110KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '1.5 TSI 110KW DSG7 CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973060%27 HTTP/1.1" 200 None
2026-03-24 23:00:25 [ayvens.be] INFO: Saving data for 1973060: {'auction_closing_time': 1774427400.0, 'created_time': 1774003698.74813, 'last_price_update_time': 1774393225.171702}
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973060') HTTP/1.1" 204 0
2026-03-24 23:00:25 [ayvens.be] INFO: Found listing with ID: 1973061
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973061%27 HTTP/1.1" 200 None
2026-03-24 23:00:25 [ayvens.be] INFO: Scrape type for 1973061: 2
2026-03-24 23:00:25 [ayvens.be] INFO: Extracting data for car ID: 1973061
2026-03-24 23:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b444df70-c745-5bd6-b42d-5581c8b7ff30 with identifier: 1973061
2026-03-24 23:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b444df70-c745-5bd6-b42d-5581c8b7ff30 with scrape type 2
2026-03-24 23:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b444df70-c745-5bd6-b42d-5581c8b7ff30 with scrape type 2
2026-03-24 23:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b444df70-c745-5bd6-b42d-5581c8b7ff30, identifier: 1973061
2026-03-24 23:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b444df70-c745-5bd6-b42d-5581c8b7ff30 with identifier: 1973061
2026-03-24 23:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b444df70-c745-5bd6-b42d-5581c8b7ff30 with identifier: 1973061
2026-03-24 23:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b444df70-c745-5bd6-b42d-5581c8b7ff30 with identifier: 1973061 to the API
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b444df70-c745-5bd6-b42d-5581c8b7ff30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q7',
 'odometer': 872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2026-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q7 3.0 TFSI E 360KW QUATTRO S LINE',
 'transmission': 'automatic',
 'trim': '3.0 TFSI E 360KW QUATTRO S LINE',
 'vin': None,
 'year': 2026}
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973061%27 HTTP/1.1" 200 None
2026-03-24 23:00:25 [ayvens.be] INFO: Saving data for 1973061: {'auction_closing_time': 1774427400.0, 'created_time': 1774003700.103627, 'last_price_update_time': 1774393225.832404}
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973061') HTTP/1.1" 204 0
2026-03-24 23:00:25 [ayvens.be] INFO: Found listing with ID: 1973062
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973062%27 HTTP/1.1" 200 None
2026-03-24 23:00:25 [ayvens.be] INFO: Scrape type for 1973062: 2
2026-03-24 23:00:25 [ayvens.be] INFO: Extracting data for car ID: 1973062
2026-03-24 23:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8498e433-fc75-561b-83f4-277776455e9e with identifier: 1973062
2026-03-24 23:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8498e433-fc75-561b-83f4-277776455e9e with scrape type 2
2026-03-24 23:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8498e433-fc75-561b-83f4-277776455e9e with scrape type 2
2026-03-24 23:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8498e433-fc75-561b-83f4-277776455e9e, identifier: 1973062
2026-03-24 23:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8498e433-fc75-561b-83f4-277776455e9e with identifier: 1973062
2026-03-24 23:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8498e433-fc75-561b-83f4-277776455e9e with identifier: 1973062
2026-03-24 23:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8498e433-fc75-561b-83f4-277776455e9e with identifier: 1973062 to the API
2026-03-24 23:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '8498e433-fc75-561b-83f4-277776455e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 83662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973062%27 HTTP/1.1" 200 None
2026-03-24 23:00:27 [ayvens.be] INFO: Saving data for 1973062: {'auction_closing_time': 1774427400.0, 'created_time': 1774003702.087273, 'last_price_update_time': 1774393227.106843}
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973062') HTTP/1.1" 204 0
2026-03-24 23:00:27 [ayvens.be] INFO: Found listing with ID: 1973063
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973063%27 HTTP/1.1" 200 None
2026-03-24 23:00:27 [ayvens.be] INFO: Scrape type for 1973063: 2
2026-03-24 23:00:27 [ayvens.be] INFO: Extracting data for car ID: 1973063
2026-03-24 23:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7644b874-004d-5b19-9d3e-0e3d272aa743 with identifier: 1973063
2026-03-24 23:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7644b874-004d-5b19-9d3e-0e3d272aa743 with scrape type 2
2026-03-24 23:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7644b874-004d-5b19-9d3e-0e3d272aa743 with scrape type 2
2026-03-24 23:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7644b874-004d-5b19-9d3e-0e3d272aa743, identifier: 1973063
2026-03-24 23:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7644b874-004d-5b19-9d3e-0e3d272aa743 with identifier: 1973063
2026-03-24 23:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7644b874-004d-5b19-9d3e-0e3d272aa743 with identifier: 1973063
2026-03-24 23:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7644b874-004d-5b19-9d3e-0e3d272aa743 with identifier: 1973063 to the API
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7644b874-004d-5b19-9d3e-0e3d272aa743',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 50544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973063%27 HTTP/1.1" 200 None
2026-03-24 23:00:27 [ayvens.be] INFO: Saving data for 1973063: {'auction_closing_time': 1774427400.0, 'created_time': 1774003703.696109, 'last_price_update_time': 1774393227.662857}
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973063') HTTP/1.1" 204 0
2026-03-24 23:00:27 [ayvens.be] INFO: Found listing with ID: 1973064
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973064%27 HTTP/1.1" 200 None
2026-03-24 23:00:27 [ayvens.be] INFO: Scrape type for 1973064: 2
2026-03-24 23:00:27 [ayvens.be] INFO: Extracting data for car ID: 1973064
2026-03-24 23:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbac6590-3267-5a72-a39a-c2b05b117efe with identifier: 1973064
2026-03-24 23:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbac6590-3267-5a72-a39a-c2b05b117efe with scrape type 2
2026-03-24 23:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbac6590-3267-5a72-a39a-c2b05b117efe with scrape type 2
2026-03-24 23:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fbac6590-3267-5a72-a39a-c2b05b117efe, identifier: 1973064
2026-03-24 23:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fbac6590-3267-5a72-a39a-c2b05b117efe with identifier: 1973064
2026-03-24 23:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fbac6590-3267-5a72-a39a-c2b05b117efe with identifier: 1973064
2026-03-24 23:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fbac6590-3267-5a72-a39a-c2b05b117efe with identifier: 1973064 to the API
2026-03-24 23:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fbac6590-3267-5a72-a39a-c2b05b117efe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3-serie',
 'odometer': 38187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3-serie 2.0 320I (135KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320I (135KW) BERLINE',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973064%27 HTTP/1.1" 200 None
2026-03-24 23:00:29 [ayvens.be] INFO: Saving data for 1973064: {'auction_closing_time': 1774427400.0, 'created_time': 1774003705.384191, 'last_price_update_time': 1774393229.639734}
2026-03-24 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973064') HTTP/1.1" 204 0
2026-03-24 23:00:29 [ayvens.be] INFO: Found listing with ID: 1973065
2026-03-24 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973065%27 HTTP/1.1" 200 None
2026-03-24 23:00:29 [ayvens.be] INFO: Scrape type for 1973065: 2
2026-03-24 23:00:29 [ayvens.be] INFO: Extracting data for car ID: 1973065
2026-03-24 23:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4881e27d-7de0-525f-89cc-eade55f21742 with identifier: 1973065
2026-03-24 23:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4881e27d-7de0-525f-89cc-eade55f21742 with scrape type 2
2026-03-24 23:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4881e27d-7de0-525f-89cc-eade55f21742 with scrape type 2
2026-03-24 23:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4881e27d-7de0-525f-89cc-eade55f21742, identifier: 1973065
2026-03-24 23:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4881e27d-7de0-525f-89cc-eade55f21742 with identifier: 1973065
2026-03-24 23:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4881e27d-7de0-525f-89cc-eade55f21742 with identifier: 1973065
2026-03-24 23:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4881e27d-7de0-525f-89cc-eade55f21742 with identifier: 1973065 to the API
2026-03-24 23:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4881e27d-7de0-525f-89cc-eade55f21742',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'VITO 116 TOURER MWB DSL - 2019',
 'odometer': 150456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ VITO 116 TOURER MWB DSL - 2019 2.0 BlueTEC A2 Base '
          '9G-T Plus (EU6.3)',
 'transmission': 'automatic',
 'trim': '2.0 BlueTEC A2 Base 9G-T Plus (EU6.3)',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973065%27 HTTP/1.1" 200 None
2026-03-24 23:00:30 [ayvens.be] INFO: Saving data for 1973065: {'auction_closing_time': 1774427400.0, 'created_time': 1774003707.86083, 'last_price_update_time': 1774393230.140981}
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973065') HTTP/1.1" 204 0
2026-03-24 23:00:30 [ayvens.be] INFO: Found listing with ID: 1973066
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973066%27 HTTP/1.1" 200 None
2026-03-24 23:00:30 [ayvens.be] INFO: Scrape type for 1973066: 2
2026-03-24 23:00:30 [ayvens.be] INFO: Extracting data for car ID: 1973066
2026-03-24 23:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1973066
2026-03-24 23:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4378404c-4d48-5176-8a9d-538d8488156b with scrape type 2
2026-03-24 23:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4378404c-4d48-5176-8a9d-538d8488156b with scrape type 2
2026-03-24 23:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4378404c-4d48-5176-8a9d-538d8488156b, identifier: 1973066
2026-03-24 23:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1973066
2026-03-24 23:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1973066
2026-03-24 23:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4378404c-4d48-5176-8a9d-538d8488156b with identifier: 1973066 to the API
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4378404c-4d48-5176-8a9d-538d8488156b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 58116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973066%27 HTTP/1.1" 200 None
2026-03-24 23:00:30 [ayvens.be] INFO: Saving data for 1973066: {'auction_closing_time': 1774427400.0, 'created_time': 1774003708.571074, 'last_price_update_time': 1774393230.528132}
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973066') HTTP/1.1" 204 0
2026-03-24 23:00:30 [ayvens.be] INFO: Found listing with ID: 1973067
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973067%27 HTTP/1.1" 200 None
2026-03-24 23:00:30 [ayvens.be] INFO: Scrape type for 1973067: 2
2026-03-24 23:00:30 [ayvens.be] INFO: Extracting data for car ID: 1973067
2026-03-24 23:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9504338f-e122-50dd-b2b1-35ff5c025eec with identifier: 1973067
2026-03-24 23:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9504338f-e122-50dd-b2b1-35ff5c025eec with scrape type 2
2026-03-24 23:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9504338f-e122-50dd-b2b1-35ff5c025eec with scrape type 2
2026-03-24 23:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9504338f-e122-50dd-b2b1-35ff5c025eec, identifier: 1973067
2026-03-24 23:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9504338f-e122-50dd-b2b1-35ff5c025eec with identifier: 1973067
2026-03-24 23:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9504338f-e122-50dd-b2b1-35ff5c025eec with identifier: 1973067
2026-03-24 23:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9504338f-e122-50dd-b2b1-35ff5c025eec with identifier: 1973067 to the API
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '9504338f-e122-50dd-b2b1-35ff5c025eec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 68648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973067%27 HTTP/1.1" 200 None
2026-03-24 23:00:30 [ayvens.be] INFO: Saving data for 1973067: {'auction_closing_time': 1774427400.0, 'created_time': 1774003709.60003, 'last_price_update_time': 1774393230.968139}
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973067') HTTP/1.1" 204 0
2026-03-24 23:00:30 [ayvens.be] INFO: Found listing with ID: 1973068
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973068%27 HTTP/1.1" 200 None
2026-03-24 23:00:31 [ayvens.be] INFO: Scrape type for 1973068: 2
2026-03-24 23:00:31 [ayvens.be] INFO: Extracting data for car ID: 1973068
2026-03-24 23:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1973068
2026-03-24 23:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59caa32e-8ead-511a-a254-01be2d4c5584 with scrape type 2
2026-03-24 23:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59caa32e-8ead-511a-a254-01be2d4c5584 with scrape type 2
2026-03-24 23:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59caa32e-8ead-511a-a254-01be2d4c5584, identifier: 1973068
2026-03-24 23:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1973068
2026-03-24 23:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1973068
2026-03-24 23:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59caa32e-8ead-511a-a254-01be2d4c5584 with identifier: 1973068 to the API
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '59caa32e-8ead-511a-a254-01be2d4c5584',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 61231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973068%27 HTTP/1.1" 200 None
2026-03-24 23:00:31 [ayvens.be] INFO: Saving data for 1973068: {'auction_closing_time': 1774427400.0, 'created_time': 1774003711.377, 'last_price_update_time': 1774393231.830939}
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973068') HTTP/1.1" 204 0
2026-03-24 23:00:31 [ayvens.be] INFO: Found listing with ID: 1973069
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973069%27 HTTP/1.1" 200 None
2026-03-24 23:00:31 [ayvens.be] INFO: Scrape type for 1973069: 2
2026-03-24 23:00:31 [ayvens.be] INFO: Extracting data for car ID: 1973069
2026-03-24 23:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 247aff3d-4ec5-514c-8ce3-b9d29760c10b with identifier: 1973069
2026-03-24 23:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247aff3d-4ec5-514c-8ce3-b9d29760c10b with scrape type 2
2026-03-24 23:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 247aff3d-4ec5-514c-8ce3-b9d29760c10b with scrape type 2
2026-03-24 23:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 247aff3d-4ec5-514c-8ce3-b9d29760c10b, identifier: 1973069
2026-03-24 23:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 247aff3d-4ec5-514c-8ce3-b9d29760c10b with identifier: 1973069
2026-03-24 23:00:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 23:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 23:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 247aff3d-4ec5-514c-8ce3-b9d29760c10b with identifier: 1973069
2026-03-24 23:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 247aff3d-4ec5-514c-8ce3-b9d29760c10b with identifier: 1973069 to the API
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'GRIS BALTIQUE METALLISE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '247aff3d-4ec5-514c-8ce3-b9d29760c10b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MAu2030GANE BERLINE',
 'odometer': 59377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MAu2030GANE BERLINE 1.3 TCE 140 GPF INTENS',
 'transmission': 'manual',
 'trim': '1.3 TCE 140 GPF INTENS',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973069%27 HTTP/1.1" 200 None
2026-03-24 23:00:32 [ayvens.be] INFO: Saving data for 1973069: {'auction_closing_time': 1774427400.0, 'created_time': 1774003712.768929, 'last_price_update_time': 1774393232.232136}
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973069') HTTP/1.1" 204 0
2026-03-24 23:00:32 [ayvens.be] INFO: Found listing with ID: 1973070
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973070%27 HTTP/1.1" 200 None
2026-03-24 23:00:32 [ayvens.be] INFO: Scrape type for 1973070: 2
2026-03-24 23:00:32 [ayvens.be] INFO: Extracting data for car ID: 1973070
2026-03-24 23:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b38e1341-3fe5-5f61-8292-5ce5d1920af7 with identifier: 1973070
2026-03-24 23:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b38e1341-3fe5-5f61-8292-5ce5d1920af7 with scrape type 2
2026-03-24 23:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b38e1341-3fe5-5f61-8292-5ce5d1920af7 with scrape type 2
2026-03-24 23:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b38e1341-3fe5-5f61-8292-5ce5d1920af7, identifier: 1973070
2026-03-24 23:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b38e1341-3fe5-5f61-8292-5ce5d1920af7 with identifier: 1973070
2026-03-24 23:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 23:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b38e1341-3fe5-5f61-8292-5ce5d1920af7 with identifier: 1973070
2026-03-24 23:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b38e1341-3fe5-5f61-8292-5ce5d1920af7 with identifier: 1973070 to the API
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'DENIM BLUE METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b38e1341-3fe5-5f61-8292-5ce5d1920af7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 206701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 T8 PHEV INSCRIPTION EXPR AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T8 PHEV INSCRIPTION EXPR AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973070%27 HTTP/1.1" 200 None
2026-03-24 23:00:32 [ayvens.be] INFO: Saving data for 1973070: {'auction_closing_time': 1774427400.0, 'created_time': 1774003715.061636, 'last_price_update_time': 1774393232.668886}
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973070') HTTP/1.1" 204 0
2026-03-24 23:00:32 [ayvens.be] INFO: Found listing with ID: 1973071
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973071%27 HTTP/1.1" 200 None
2026-03-24 23:00:32 [ayvens.be] INFO: Scrape type for 1973071: 2
2026-03-24 23:00:32 [ayvens.be] INFO: Extracting data for car ID: 1973071
2026-03-24 23:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12289a12-0c04-523e-987a-1dd4ffa9f663 with identifier: 1973071
2026-03-24 23:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12289a12-0c04-523e-987a-1dd4ffa9f663 with scrape type 2
2026-03-24 23:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12289a12-0c04-523e-987a-1dd4ffa9f663 with scrape type 2
2026-03-24 23:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 12289a12-0c04-523e-987a-1dd4ffa9f663, identifier: 1973071
2026-03-24 23:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 12289a12-0c04-523e-987a-1dd4ffa9f663 with identifier: 1973071
2026-03-24 23:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 23:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 12289a12-0c04-523e-987a-1dd4ffa9f663 with identifier: 1973071
2026-03-24 23:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 12289a12-0c04-523e-987a-1dd4ffa9f663 with identifier: 1973071 to the API
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'ARTENSE GREY',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '12289a12-0c04-523e-987a-1dd4ffa9f663',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 156833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.5 BLUEHDI 96KW S-S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 96KW S-S AUTO ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973071%27 HTTP/1.1" 200 None
2026-03-24 23:00:33 [ayvens.be] INFO: Saving data for 1973071: {'auction_closing_time': 1774427400.0, 'created_time': 1774003716.742743, 'last_price_update_time': 1774393233.094314}
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973071') HTTP/1.1" 204 0
2026-03-24 23:00:33 [ayvens.be] INFO: Found listing with ID: 1973072
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973072%27 HTTP/1.1" 200 None
2026-03-24 23:00:33 [ayvens.be] INFO: Scrape type for 1973072: 2
2026-03-24 23:00:33 [ayvens.be] INFO: Extracting data for car ID: 1973072
2026-03-24 23:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28512b0f-3072-5354-b2d2-6bdbaa0ef941 with identifier: 1973072
2026-03-24 23:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28512b0f-3072-5354-b2d2-6bdbaa0ef941 with scrape type 2
2026-03-24 23:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28512b0f-3072-5354-b2d2-6bdbaa0ef941 with scrape type 2
2026-03-24 23:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 28512b0f-3072-5354-b2d2-6bdbaa0ef941, identifier: 1973072
2026-03-24 23:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 28512b0f-3072-5354-b2d2-6bdbaa0ef941 with identifier: 1973072
2026-03-24 23:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 23:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 28512b0f-3072-5354-b2d2-6bdbaa0ef941 with identifier: 1973072
2026-03-24 23:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 28512b0f-3072-5354-b2d2-6bdbaa0ef941 with identifier: 1973072 to the API
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLANC BANQUISE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '28512b0f-3072-5354-b2d2-6bdbaa0ef941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO VAN SWB - 2019',
 'odometer': 20944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO VAN SWB - 2019 1.2 PureTech M Light Control '
          'S-S (EU6.2)',
 'transmission': 'manual',
 'trim': '1.2 PureTech M Light Control S-S (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973072%27 HTTP/1.1" 200 None
2026-03-24 23:00:33 [ayvens.be] INFO: Saving data for 1973072: {'auction_closing_time': 1774427400.0, 'created_time': 1774003718.160136, 'last_price_update_time': 1774393233.504555}
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973072') HTTP/1.1" 204 0
2026-03-24 23:00:33 [ayvens.be] INFO: Found listing with ID: 1973073
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973073%27 HTTP/1.1" 200 None
2026-03-24 23:00:33 [ayvens.be] INFO: Scrape type for 1973073: 2
2026-03-24 23:00:33 [ayvens.be] INFO: Extracting data for car ID: 1973073
2026-03-24 23:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a55465d-6c76-5777-be16-1a0c6d685d2e with identifier: 1973073
2026-03-24 23:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a55465d-6c76-5777-be16-1a0c6d685d2e with scrape type 2
2026-03-24 23:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a55465d-6c76-5777-be16-1a0c6d685d2e with scrape type 2
2026-03-24 23:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6a55465d-6c76-5777-be16-1a0c6d685d2e, identifier: 1973073
2026-03-24 23:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6a55465d-6c76-5777-be16-1a0c6d685d2e with identifier: 1973073
2026-03-24 23:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 23:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6a55465d-6c76-5777-be16-1a0c6d685d2e with identifier: 1973073
2026-03-24 23:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6a55465d-6c76-5777-be16-1a0c6d685d2e with identifier: 1973073 to the API
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'PEARL WHITE MULTI',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': '6a55465d-6c76-5777-be16-1a0c6d685d2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 95625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 50 KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': '50 KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973073%27 HTTP/1.1" 200 None
2026-03-24 23:00:33 [ayvens.be] INFO: Saving data for 1973073: {'auction_closing_time': 1774427400.0, 'created_time': 1774003719.12669, 'last_price_update_time': 1774393233.900835}
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973073') HTTP/1.1" 204 0
2026-03-24 23:00:34 [ayvens.be] INFO: Found listing with ID: 1973074
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973074%27 HTTP/1.1" 200 None
2026-03-24 23:00:34 [ayvens.be] INFO: Scrape type for 1973074: 2
2026-03-24 23:00:34 [ayvens.be] INFO: Extracting data for car ID: 1973074
2026-03-24 23:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2360208b-2c91-52fd-a768-73695cd72a34 with identifier: 1973074
2026-03-24 23:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2360208b-2c91-52fd-a768-73695cd72a34 with scrape type 2
2026-03-24 23:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2360208b-2c91-52fd-a768-73695cd72a34 with scrape type 2
2026-03-24 23:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2360208b-2c91-52fd-a768-73695cd72a34, identifier: 1973074
2026-03-24 23:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2360208b-2c91-52fd-a768-73695cd72a34 with identifier: 1973074
2026-03-24 23:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 23:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2360208b-2c91-52fd-a768-73695cd72a34 with identifier: 1973074
2026-03-24 23:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2360208b-2c91-52fd-a768-73695cd72a34 with identifier: 1973074 to the API
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 214,
 'color': 'CANDY WHITE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '2360208b-2c91-52fd-a768-73695cd72a34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER 50A FOURGON LWB HR DSL',
 'odometer': 54930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 50A FOURGON LWB HR DSL 2.0 CR TDi L4H3 RDW',
 'transmission': 'manual',
 'trim': '2.0 CR TDi L4H3 RDW',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973074%27 HTTP/1.1" 200 None
2026-03-24 23:00:34 [ayvens.be] INFO: Saving data for 1973074: {'auction_closing_time': 1774427400.0, 'created_time': 1774003720.560492, 'last_price_update_time': 1774393234.381238}
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973074') HTTP/1.1" 204 0
2026-03-24 23:00:34 [ayvens.be] INFO: Found listing with ID: 1973075
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973075%27 HTTP/1.1" 200 None
2026-03-24 23:00:34 [ayvens.be] INFO: Scrape type for 1973075: 2
2026-03-24 23:00:34 [ayvens.be] INFO: Extracting data for car ID: 1973075
2026-03-24 23:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc0a598f-1b86-5fda-8ad8-b09294c1081c with identifier: 1973075
2026-03-24 23:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc0a598f-1b86-5fda-8ad8-b09294c1081c with scrape type 2
2026-03-24 23:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc0a598f-1b86-5fda-8ad8-b09294c1081c with scrape type 2
2026-03-24 23:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cc0a598f-1b86-5fda-8ad8-b09294c1081c, identifier: 1973075
2026-03-24 23:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cc0a598f-1b86-5fda-8ad8-b09294c1081c with identifier: 1973075
2026-03-24 23:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-24 23:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cc0a598f-1b86-5fda-8ad8-b09294c1081c with identifier: 1973075
2026-03-24 23:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cc0a598f-1b86-5fda-8ad8-b09294c1081c with identifier: 1973075 to the API
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'SKYSCRAPER GRAU',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cc0a598f-1b86-5fda-8ad8-b09294c1081c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 46935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 218IA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 218IA GRAN COUPE',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973075%27 HTTP/1.1" 200 None
2026-03-24 23:00:34 [ayvens.be] INFO: Saving data for 1973075: {'auction_closing_time': 1774427400.0, 'created_time': 1774003722.216143, 'last_price_update_time': 1774393234.802984}
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973075') HTTP/1.1" 204 0
2026-03-24 23:00:34 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1000
2026-03-24 23:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 23:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 23:00:37 [ayvens.be] INFO: Found listing with ID: 1973076
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973076%27 HTTP/1.1" 200 None
2026-03-24 23:00:37 [ayvens.be] INFO: Scrape type for 1973076: 2
2026-03-24 23:00:37 [ayvens.be] INFO: Extracting data for car ID: 1973076
2026-03-24 23:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1198723-f8ec-5f0f-b2cd-1f150869b61d with identifier: 1973076
2026-03-24 23:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1198723-f8ec-5f0f-b2cd-1f150869b61d with scrape type 2
2026-03-24 23:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1198723-f8ec-5f0f-b2cd-1f150869b61d with scrape type 2
2026-03-24 23:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1198723-f8ec-5f0f-b2cd-1f150869b61d, identifier: 1973076
2026-03-24 23:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1198723-f8ec-5f0f-b2cd-1f150869b61d with identifier: 1973076
2026-03-24 23:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1198723-f8ec-5f0f-b2cd-1f150869b61d with identifier: 1973076
2026-03-24 23:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1198723-f8ec-5f0f-b2cd-1f150869b61d with identifier: 1973076 to the API
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e1198723-f8ec-5f0f-b2cd-1f150869b61d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 142392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 316DA (90KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 316DA (90KW) TOURING',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973076%27 HTTP/1.1" 200 None
2026-03-24 23:00:37 [ayvens.be] INFO: Saving data for 1973076: {'auction_closing_time': 1774427400.0, 'created_time': 1774003724.387857, 'last_price_update_time': 1774393237.676767}
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973076') HTTP/1.1" 204 0
2026-03-24 23:00:37 [ayvens.be] INFO: Found listing with ID: 1973077
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973077%27 HTTP/1.1" 200 None
2026-03-24 23:00:37 [ayvens.be] INFO: Scrape type for 1973077: 2
2026-03-24 23:00:37 [ayvens.be] INFO: Extracting data for car ID: 1973077
2026-03-24 23:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a3d8b72-0ae5-5b88-b2b7-855429f694c6 with identifier: 1973077
2026-03-24 23:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a3d8b72-0ae5-5b88-b2b7-855429f694c6 with scrape type 2
2026-03-24 23:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a3d8b72-0ae5-5b88-b2b7-855429f694c6 with scrape type 2
2026-03-24 23:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0a3d8b72-0ae5-5b88-b2b7-855429f694c6, identifier: 1973077
2026-03-24 23:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0a3d8b72-0ae5-5b88-b2b7-855429f694c6 with identifier: 1973077
2026-03-24 23:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0a3d8b72-0ae5-5b88-b2b7-855429f694c6 with identifier: 1973077
2026-03-24 23:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0a3d8b72-0ae5-5b88-b2b7-855429f694c6 with identifier: 1973077 to the API
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0a3d8b72-0ae5-5b88-b2b7-855429f694c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM 290S FOU SWB DS',
 'odometer': 73926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM 290S FOU SWB DS 2.0 TDCi L1H1 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L1H1 Trend STOCK',
 'vin': None,
 'year': 2017}
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973077%27 HTTP/1.1" 200 None
2026-03-24 23:00:38 [ayvens.be] INFO: Saving data for 1973077: {'auction_closing_time': 1774427400.0, 'created_time': 1774003726.05993, 'last_price_update_time': 1774393238.081647}
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973077') HTTP/1.1" 204 0
2026-03-24 23:00:38 [ayvens.be] INFO: Found listing with ID: 1973078
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973078%27 HTTP/1.1" 200 None
2026-03-24 23:00:38 [ayvens.be] INFO: Scrape type for 1973078: 2
2026-03-24 23:00:38 [ayvens.be] INFO: Extracting data for car ID: 1973078
2026-03-24 23:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2825fb8-0b0d-5024-8407-866e028e3bf9 with identifier: 1973078
2026-03-24 23:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2825fb8-0b0d-5024-8407-866e028e3bf9 with scrape type 2
2026-03-24 23:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2825fb8-0b0d-5024-8407-866e028e3bf9 with scrape type 2
2026-03-24 23:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e2825fb8-0b0d-5024-8407-866e028e3bf9, identifier: 1973078
2026-03-24 23:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e2825fb8-0b0d-5024-8407-866e028e3bf9 with identifier: 1973078
2026-03-24 23:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e2825fb8-0b0d-5024-8407-866e028e3bf9 with identifier: 1973078
2026-03-24 23:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e2825fb8-0b0d-5024-8407-866e028e3bf9 with identifier: 1973078 to the API
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e2825fb8-0b0d-5024-8407-866e028e3bf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 75304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973078%27 HTTP/1.1" 200 None
2026-03-24 23:00:38 [ayvens.be] INFO: Saving data for 1973078: {'auction_closing_time': 1774427400.0, 'created_time': 1774003727.338711, 'last_price_update_time': 1774393238.490553}
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973078') HTTP/1.1" 204 0
2026-03-24 23:00:38 [ayvens.be] INFO: Found listing with ID: 1973079
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973079%27 HTTP/1.1" 200 None
2026-03-24 23:00:38 [ayvens.be] INFO: Scrape type for 1973079: 2
2026-03-24 23:00:38 [ayvens.be] INFO: Extracting data for car ID: 1973079
2026-03-24 23:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7443f900-3bb4-5cff-84db-7ab76ba4ec4d with identifier: 1973079
2026-03-24 23:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7443f900-3bb4-5cff-84db-7ab76ba4ec4d with scrape type 2
2026-03-24 23:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7443f900-3bb4-5cff-84db-7ab76ba4ec4d with scrape type 2
2026-03-24 23:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7443f900-3bb4-5cff-84db-7ab76ba4ec4d, identifier: 1973079
2026-03-24 23:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7443f900-3bb4-5cff-84db-7ab76ba4ec4d with identifier: 1973079
2026-03-24 23:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7443f900-3bb4-5cff-84db-7ab76ba4ec4d with identifier: 1973079
2026-03-24 23:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7443f900-3bb4-5cff-84db-7ab76ba4ec4d with identifier: 1973079 to the API
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7443f900-3bb4-5cff-84db-7ab76ba4ec4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 78028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON 1.4 PHEV DSG R-LINE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.4 PHEV DSG R-LINE BUSINESS',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973079%27 HTTP/1.1" 200 None
2026-03-24 23:00:38 [ayvens.be] INFO: Saving data for 1973079: {'auction_closing_time': 1774427400.0, 'created_time': 1774003729.350927, 'last_price_update_time': 1774393238.920951}
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973079') HTTP/1.1" 204 0
2026-03-24 23:00:38 [ayvens.be] INFO: Found listing with ID: 1973080
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973080%27 HTTP/1.1" 200 None
2026-03-24 23:00:38 [ayvens.be] INFO: Scrape type for 1973080: 2
2026-03-24 23:00:38 [ayvens.be] INFO: Extracting data for car ID: 1973080
2026-03-24 23:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d0d7f7f-65df-5fff-9b08-89f788c1b48b with identifier: 1973080
2026-03-24 23:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d0d7f7f-65df-5fff-9b08-89f788c1b48b with scrape type 2
2026-03-24 23:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d0d7f7f-65df-5fff-9b08-89f788c1b48b with scrape type 2
2026-03-24 23:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6d0d7f7f-65df-5fff-9b08-89f788c1b48b, identifier: 1973080
2026-03-24 23:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6d0d7f7f-65df-5fff-9b08-89f788c1b48b with identifier: 1973080
2026-03-24 23:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6d0d7f7f-65df-5fff-9b08-89f788c1b48b with identifier: 1973080
2026-03-24 23:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6d0d7f7f-65df-5fff-9b08-89f788c1b48b with identifier: 1973080 to the API
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '6d0d7f7f-65df-5fff-9b08-89f788c1b48b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 47819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.5 TSI 96KW LIFE',
 'transmission': 'manual',
 'trim': '1.5 TSI 96KW LIFE',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973080%27 HTTP/1.1" 200 None
2026-03-24 23:00:39 [ayvens.be] INFO: Saving data for 1973080: {'auction_closing_time': 1774427400.0, 'created_time': 1774003731.226545, 'last_price_update_time': 1774393239.319123}
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973080') HTTP/1.1" 204 0
2026-03-24 23:00:39 [ayvens.be] INFO: Found listing with ID: 1973081
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973081%27 HTTP/1.1" 200 None
2026-03-24 23:00:39 [ayvens.be] INFO: Scrape type for 1973081: 2
2026-03-24 23:00:39 [ayvens.be] INFO: Extracting data for car ID: 1973081
2026-03-24 23:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fce7ebe-3f7a-50aa-a858-f5e1e20c3c99 with identifier: 1973081
2026-03-24 23:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fce7ebe-3f7a-50aa-a858-f5e1e20c3c99 with scrape type 2
2026-03-24 23:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fce7ebe-3f7a-50aa-a858-f5e1e20c3c99 with scrape type 2
2026-03-24 23:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4fce7ebe-3f7a-50aa-a858-f5e1e20c3c99, identifier: 1973081
2026-03-24 23:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4fce7ebe-3f7a-50aa-a858-f5e1e20c3c99 with identifier: 1973081
2026-03-24 23:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4fce7ebe-3f7a-50aa-a858-f5e1e20c3c99 with identifier: 1973081
2026-03-24 23:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4fce7ebe-3f7a-50aa-a858-f5e1e20c3c99 with identifier: 1973081 to the API
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4fce7ebe-3f7a-50aa-a858-f5e1e20c3c99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-MAX',
 'odometer': 93757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD S-MAX 2.0 TDCI 139KW S-S AUTO VIGNALE',
 'transmission': 'automatic',
 'trim': '2.0 TDCI 139KW S-S AUTO VIGNALE',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973081%27 HTTP/1.1" 200 None
2026-03-24 23:00:39 [ayvens.be] INFO: Saving data for 1973081: {'auction_closing_time': 1774427400.0, 'created_time': 1774003733.109188, 'last_price_update_time': 1774393239.698158}
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973081') HTTP/1.1" 204 0
2026-03-24 23:00:39 [ayvens.be] INFO: Found listing with ID: 1973082
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973082%27 HTTP/1.1" 200 None
2026-03-24 23:00:39 [ayvens.be] INFO: Scrape type for 1973082: 2
2026-03-24 23:00:39 [ayvens.be] INFO: Extracting data for car ID: 1973082
2026-03-24 23:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09be8eaa-7877-5d38-9012-375f4cb9ca48 with identifier: 1973082
2026-03-24 23:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09be8eaa-7877-5d38-9012-375f4cb9ca48 with scrape type 2
2026-03-24 23:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09be8eaa-7877-5d38-9012-375f4cb9ca48 with scrape type 2
2026-03-24 23:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09be8eaa-7877-5d38-9012-375f4cb9ca48, identifier: 1973082
2026-03-24 23:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09be8eaa-7877-5d38-9012-375f4cb9ca48 with identifier: 1973082
2026-03-24 23:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09be8eaa-7877-5d38-9012-375f4cb9ca48 with identifier: 1973082
2026-03-24 23:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09be8eaa-7877-5d38-9012-375f4cb9ca48 with identifier: 1973082 to the API
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '09be8eaa-7877-5d38-9012-375f4cb9ca48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 119455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 D3 GEARTRONIC INSCRIPTION',
 'transmission': 'automatic',
 'trim': '2.0 D3 GEARTRONIC INSCRIPTION',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973082%27 HTTP/1.1" 200 None
2026-03-24 23:00:40 [ayvens.be] INFO: Saving data for 1973082: {'auction_closing_time': 1774427400.0, 'created_time': 1774003734.107192, 'last_price_update_time': 1774393240.128334}
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973082') HTTP/1.1" 204 0
2026-03-24 23:00:40 [ayvens.be] INFO: Found listing with ID: 1973084
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973084%27 HTTP/1.1" 200 None
2026-03-24 23:00:40 [ayvens.be] INFO: Scrape type for 1973084: 2
2026-03-24 23:00:40 [ayvens.be] INFO: Extracting data for car ID: 1973084
2026-03-24 23:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51e388ec-1dd9-5d87-b598-df837c349117 with identifier: 1973084
2026-03-24 23:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51e388ec-1dd9-5d87-b598-df837c349117 with scrape type 2
2026-03-24 23:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51e388ec-1dd9-5d87-b598-df837c349117 with scrape type 2
2026-03-24 23:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 51e388ec-1dd9-5d87-b598-df837c349117, identifier: 1973084
2026-03-24 23:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 51e388ec-1dd9-5d87-b598-df837c349117 with identifier: 1973084
2026-03-24 23:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 51e388ec-1dd9-5d87-b598-df837c349117 with identifier: 1973084
2026-03-24 23:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 51e388ec-1dd9-5d87-b598-df837c349117 with identifier: 1973084 to the API
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '51e388ec-1dd9-5d87-b598-df837c349117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 147656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA sDrive18 OPF',
 'transmission': 'automatic',
 'trim': '1.5iA sDrive18 OPF',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973084%27 HTTP/1.1" 200 None
2026-03-24 23:00:40 [ayvens.be] INFO: Saving data for 1973084: {'auction_closing_time': 1774427400.0, 'created_time': 1774003737.164375, 'last_price_update_time': 1774393240.557288}
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973084') HTTP/1.1" 204 0
2026-03-24 23:00:40 [ayvens.be] INFO: Found listing with ID: 1973085
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973085%27 HTTP/1.1" 200 None
2026-03-24 23:00:40 [ayvens.be] INFO: Scrape type for 1973085: 2
2026-03-24 23:00:40 [ayvens.be] INFO: Extracting data for car ID: 1973085
2026-03-24 23:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba95b0b-a034-5a00-8017-d1d9648db01a with identifier: 1973085
2026-03-24 23:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba95b0b-a034-5a00-8017-d1d9648db01a with scrape type 2
2026-03-24 23:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba95b0b-a034-5a00-8017-d1d9648db01a with scrape type 2
2026-03-24 23:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4ba95b0b-a034-5a00-8017-d1d9648db01a, identifier: 1973085
2026-03-24 23:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4ba95b0b-a034-5a00-8017-d1d9648db01a with identifier: 1973085
2026-03-24 23:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4ba95b0b-a034-5a00-8017-d1d9648db01a with identifier: 1973085
2026-03-24 23:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4ba95b0b-a034-5a00-8017-d1d9648db01a with identifier: 1973085 to the API
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4ba95b0b-a034-5a00-8017-d1d9648db01a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS CROSS',
 'odometer': 19704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS CROSS 1.5 VVT-IE HEV ELEGANT BI-TONE CVT',
 'transmission': 'automatic',
 'trim': '1.5 VVT-IE HEV ELEGANT BI-TONE CVT',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973085%27 HTTP/1.1" 200 None
2026-03-24 23:00:40 [ayvens.be] INFO: Saving data for 1973085: {'auction_closing_time': 1774427400.0, 'created_time': 1774003739.745557, 'last_price_update_time': 1774393240.983693}
2026-03-24 23:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973085') HTTP/1.1" 204 0
2026-03-24 23:00:41 [ayvens.be] INFO: Found listing with ID: 1973086
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973086%27 HTTP/1.1" 200 None
2026-03-24 23:00:41 [ayvens.be] INFO: Scrape type for 1973086: 2
2026-03-24 23:00:41 [ayvens.be] INFO: Extracting data for car ID: 1973086
2026-03-24 23:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9609c1fa-bc94-5922-8ed6-0d64d8c5b92c with identifier: 1973086
2026-03-24 23:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9609c1fa-bc94-5922-8ed6-0d64d8c5b92c with scrape type 2
2026-03-24 23:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9609c1fa-bc94-5922-8ed6-0d64d8c5b92c with scrape type 2
2026-03-24 23:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9609c1fa-bc94-5922-8ed6-0d64d8c5b92c, identifier: 1973086
2026-03-24 23:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9609c1fa-bc94-5922-8ed6-0d64d8c5b92c with identifier: 1973086
2026-03-24 23:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9609c1fa-bc94-5922-8ed6-0d64d8c5b92c with identifier: 1973086
2026-03-24 23:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9609c1fa-bc94-5922-8ed6-0d64d8c5b92c with identifier: 1973086 to the API
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '9609c1fa-bc94-5922-8ed6-0d64d8c5b92c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 113755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TFSI 110KW S TRONIC BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI 110KW S TRONIC BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973086%27 HTTP/1.1" 200 None
2026-03-24 23:00:41 [ayvens.be] INFO: Saving data for 1973086: {'auction_closing_time': 1774427400.0, 'created_time': 1774003741.748799, 'last_price_update_time': 1774393241.463333}
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973086') HTTP/1.1" 204 0
2026-03-24 23:00:41 [ayvens.be] INFO: Found listing with ID: 1973087
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973087%27 HTTP/1.1" 200 None
2026-03-24 23:00:41 [ayvens.be] INFO: Scrape type for 1973087: 2
2026-03-24 23:00:41 [ayvens.be] INFO: Extracting data for car ID: 1973087
2026-03-24 23:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db82f63-656f-5dda-8938-fecc87a38fdd with identifier: 1973087
2026-03-24 23:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db82f63-656f-5dda-8938-fecc87a38fdd with scrape type 2
2026-03-24 23:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7db82f63-656f-5dda-8938-fecc87a38fdd with scrape type 2
2026-03-24 23:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7db82f63-656f-5dda-8938-fecc87a38fdd, identifier: 1973087
2026-03-24 23:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7db82f63-656f-5dda-8938-fecc87a38fdd with identifier: 1973087
2026-03-24 23:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7db82f63-656f-5dda-8938-fecc87a38fdd with identifier: 1973087
2026-03-24 23:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7db82f63-656f-5dda-8938-fecc87a38fdd with identifier: 1973087 to the API
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '7db82f63-656f-5dda-8938-fecc87a38fdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 149051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318DA (110KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318DA (110KW) TOURING',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973087%27 HTTP/1.1" 200 None
2026-03-24 23:00:41 [ayvens.be] INFO: Saving data for 1973087: {'auction_closing_time': 1774427400.0, 'created_time': 1774003742.943784, 'last_price_update_time': 1774393241.857522}
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973087') HTTP/1.1" 204 0
2026-03-24 23:00:41 [ayvens.be] INFO: Found listing with ID: 1973088
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973088%27 HTTP/1.1" 200 None
2026-03-24 23:00:41 [ayvens.be] INFO: Scrape type for 1973088: 2
2026-03-24 23:00:41 [ayvens.be] INFO: Extracting data for car ID: 1973088
2026-03-24 23:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c75a1604-421a-5e52-85f1-9378b7332b1c with identifier: 1973088
2026-03-24 23:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c75a1604-421a-5e52-85f1-9378b7332b1c with scrape type 2
2026-03-24 23:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c75a1604-421a-5e52-85f1-9378b7332b1c with scrape type 2
2026-03-24 23:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c75a1604-421a-5e52-85f1-9378b7332b1c, identifier: 1973088
2026-03-24 23:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c75a1604-421a-5e52-85f1-9378b7332b1c with identifier: 1973088
2026-03-24 23:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c75a1604-421a-5e52-85f1-9378b7332b1c with identifier: 1973088
2026-03-24 23:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c75a1604-421a-5e52-85f1-9378b7332b1c with identifier: 1973088 to the API
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c75a1604-421a-5e52-85f1-9378b7332b1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 84519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2018}
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973088%27 HTTP/1.1" 200 None
2026-03-24 23:00:42 [ayvens.be] INFO: Saving data for 1973088: {'auction_closing_time': 1774427400.0, 'created_time': 1774003744.248173, 'last_price_update_time': 1774393242.236619}
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973088') HTTP/1.1" 204 0
2026-03-24 23:00:42 [ayvens.be] INFO: Found listing with ID: 1973089
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973089%27 HTTP/1.1" 200 None
2026-03-24 23:00:42 [ayvens.be] INFO: Scrape type for 1973089: 2
2026-03-24 23:00:42 [ayvens.be] INFO: Extracting data for car ID: 1973089
2026-03-24 23:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbbf5cb4-8180-50cd-a70a-44a6cd90cb87 with identifier: 1973089
2026-03-24 23:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbbf5cb4-8180-50cd-a70a-44a6cd90cb87 with scrape type 2
2026-03-24 23:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbbf5cb4-8180-50cd-a70a-44a6cd90cb87 with scrape type 2
2026-03-24 23:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fbbf5cb4-8180-50cd-a70a-44a6cd90cb87, identifier: 1973089
2026-03-24 23:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fbbf5cb4-8180-50cd-a70a-44a6cd90cb87 with identifier: 1973089
2026-03-24 23:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fbbf5cb4-8180-50cd-a70a-44a6cd90cb87 with identifier: 1973089
2026-03-24 23:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fbbf5cb4-8180-50cd-a70a-44a6cd90cb87 with identifier: 1973089 to the API
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fbbf5cb4-8180-50cd-a70a-44a6cd90cb87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40 DIESEL',
 'odometer': 132433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 DIESEL 2.0 D3 Momentum Pro Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D3 Momentum Pro Geartronic',
 'vin': None,
 'year': 2019}
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973089%27 HTTP/1.1" 200 None
2026-03-24 23:00:42 [ayvens.be] INFO: Saving data for 1973089: {'auction_closing_time': 1774427400.0, 'created_time': 1774003745.705448, 'last_price_update_time': 1774393242.615726}
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973089') HTTP/1.1" 204 0
2026-03-24 23:00:42 [ayvens.be] INFO: Found listing with ID: 1973090
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973090%27 HTTP/1.1" 200 None
2026-03-24 23:00:42 [ayvens.be] INFO: Scrape type for 1973090: 2
2026-03-24 23:00:42 [ayvens.be] INFO: Extracting data for car ID: 1973090
2026-03-24 23:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1973090
2026-03-24 23:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce58b6a6-8a34-5601-8af8-073b8badc5c5 with scrape type 2
2026-03-24 23:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce58b6a6-8a34-5601-8af8-073b8badc5c5 with scrape type 2
2026-03-24 23:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ce58b6a6-8a34-5601-8af8-073b8badc5c5, identifier: 1973090
2026-03-24 23:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1973090
2026-03-24 23:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1973090
2026-03-24 23:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ce58b6a6-8a34-5601-8af8-073b8badc5c5 with identifier: 1973090 to the API
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ce58b6a6-8a34-5601-8af8-073b8badc5c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 60155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E LUXURY LINE DCT SH '
          'BR',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E LUXURY LINE DCT SH BR',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973090%27 HTTP/1.1" 200 None
2026-03-24 23:00:42 [ayvens.be] INFO: Saving data for 1973090: {'auction_closing_time': 1774427400.0, 'created_time': 1774003749.843915, 'last_price_update_time': 1774393242.996534}
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973090') HTTP/1.1" 204 0
2026-03-24 23:00:43 [ayvens.be] INFO: Found listing with ID: 1973091
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973091%27 HTTP/1.1" 200 None
2026-03-24 23:00:43 [ayvens.be] INFO: Scrape type for 1973091: 2
2026-03-24 23:00:43 [ayvens.be] INFO: Extracting data for car ID: 1973091
2026-03-24 23:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b357a1-88c9-54aa-86a7-06112225e25c with identifier: 1973091
2026-03-24 23:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b357a1-88c9-54aa-86a7-06112225e25c with scrape type 2
2026-03-24 23:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63b357a1-88c9-54aa-86a7-06112225e25c with scrape type 2
2026-03-24 23:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63b357a1-88c9-54aa-86a7-06112225e25c, identifier: 1973091
2026-03-24 23:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63b357a1-88c9-54aa-86a7-06112225e25c with identifier: 1973091
2026-03-24 23:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63b357a1-88c9-54aa-86a7-06112225e25c with identifier: 1973091
2026-03-24 23:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63b357a1-88c9-54aa-86a7-06112225e25c with identifier: 1973091 to the API
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': '63b357a1-88c9-54aa-86a7-06112225e25c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'BORN',
 'odometer': 81,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA BORN BEV 63KWH 170KW E-BOOST BUSINESS',
 'transmission': 'automatic',
 'trim': 'BEV 63KWH 170KW E-BOOST BUSINESS',
 'vin': None,
 'year': 2025}
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973091%27 HTTP/1.1" 200 None
2026-03-24 23:00:43 [ayvens.be] INFO: Saving data for 1973091: {'auction_closing_time': 1774427400.0, 'created_time': 1774003750.892647, 'last_price_update_time': 1774393243.362501}
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973091') HTTP/1.1" 204 0
2026-03-24 23:00:43 [ayvens.be] INFO: Found listing with ID: 1973092
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973092%27 HTTP/1.1" 200 None
2026-03-24 23:00:43 [ayvens.be] INFO: Scrape type for 1973092: 2
2026-03-24 23:00:43 [ayvens.be] INFO: Extracting data for car ID: 1973092
2026-03-24 23:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54936e6d-4369-52d4-8b65-3801e712fcb1 with identifier: 1973092
2026-03-24 23:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54936e6d-4369-52d4-8b65-3801e712fcb1 with scrape type 2
2026-03-24 23:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54936e6d-4369-52d4-8b65-3801e712fcb1 with scrape type 2
2026-03-24 23:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 54936e6d-4369-52d4-8b65-3801e712fcb1, identifier: 1973092
2026-03-24 23:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 54936e6d-4369-52d4-8b65-3801e712fcb1 with identifier: 1973092
2026-03-24 23:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 54936e6d-4369-52d4-8b65-3801e712fcb1 with identifier: 1973092
2026-03-24 23:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 54936e6d-4369-52d4-8b65-3801e712fcb1 with identifier: 1973092 to the API
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '54936e6d-4369-52d4-8b65-3801e712fcb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 51167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV Inscription Expres.',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV Inscription Expres.',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973092%27 HTTP/1.1" 200 None
2026-03-24 23:00:43 [ayvens.be] INFO: Saving data for 1973092: {'auction_closing_time': 1774427400.0, 'created_time': 1774003751.949938, 'last_price_update_time': 1774393243.751124}
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973092') HTTP/1.1" 204 0
2026-03-24 23:00:43 [ayvens.be] INFO: Found listing with ID: 1973093
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973093%27 HTTP/1.1" 200 None
2026-03-24 23:00:43 [ayvens.be] INFO: Scrape type for 1973093: 2
2026-03-24 23:00:43 [ayvens.be] INFO: Extracting data for car ID: 1973093
2026-03-24 23:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4092a452-e608-516e-8e89-d7f87ac5bd84 with identifier: 1973093
2026-03-24 23:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4092a452-e608-516e-8e89-d7f87ac5bd84 with scrape type 2
2026-03-24 23:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4092a452-e608-516e-8e89-d7f87ac5bd84 with scrape type 2
2026-03-24 23:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4092a452-e608-516e-8e89-d7f87ac5bd84, identifier: 1973093
2026-03-24 23:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4092a452-e608-516e-8e89-d7f87ac5bd84 with identifier: 1973093
2026-03-24 23:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4092a452-e608-516e-8e89-d7f87ac5bd84 with identifier: 1973093
2026-03-24 23:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4092a452-e608-516e-8e89-d7f87ac5bd84 with identifier: 1973093 to the API
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4092a452-e608-516e-8e89-d7f87ac5bd84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 87978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973093%27 HTTP/1.1" 200 None
2026-03-24 23:00:44 [ayvens.be] INFO: Saving data for 1973093: {'auction_closing_time': 1774427400.0, 'created_time': 1774003753.924894, 'last_price_update_time': 1774393244.176898}
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973093') HTTP/1.1" 204 0
2026-03-24 23:00:44 [ayvens.be] INFO: Found listing with ID: 1973094
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973094%27 HTTP/1.1" 200 None
2026-03-24 23:00:44 [ayvens.be] INFO: Scrape type for 1973094: 2
2026-03-24 23:00:44 [ayvens.be] INFO: Extracting data for car ID: 1973094
2026-03-24 23:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f014ed-6539-5a4e-a17d-f956cc6eb504 with identifier: 1973094
2026-03-24 23:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f014ed-6539-5a4e-a17d-f956cc6eb504 with scrape type 2
2026-03-24 23:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f014ed-6539-5a4e-a17d-f956cc6eb504 with scrape type 2
2026-03-24 23:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17f014ed-6539-5a4e-a17d-f956cc6eb504, identifier: 1973094
2026-03-24 23:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17f014ed-6539-5a4e-a17d-f956cc6eb504 with identifier: 1973094
2026-03-24 23:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17f014ed-6539-5a4e-a17d-f956cc6eb504 with identifier: 1973094
2026-03-24 23:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17f014ed-6539-5a4e-a17d-f956cc6eb504 with identifier: 1973094 to the API
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '17f014ed-6539-5a4e-a17d-f956cc6eb504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO',
 'odometer': 67651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TAIGO 1.0 TSI 81KW DSG LIFE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.0 TSI 81KW DSG LIFE BUSINESS',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973094%27 HTTP/1.1" 200 None
2026-03-24 23:00:44 [ayvens.be] INFO: Saving data for 1973094: {'auction_closing_time': 1774427400.0, 'created_time': 1774003754.876089, 'last_price_update_time': 1774393244.550221}
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973094') HTTP/1.1" 204 0
2026-03-24 23:00:44 [ayvens.be] INFO: Found listing with ID: 1973095
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973095%27 HTTP/1.1" 200 None
2026-03-24 23:00:44 [ayvens.be] INFO: Scrape type for 1973095: 2
2026-03-24 23:00:44 [ayvens.be] INFO: Extracting data for car ID: 1973095
2026-03-24 23:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1973095
2026-03-24 23:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with scrape type 2
2026-03-24 23:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with scrape type 2
2026-03-24 23:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a, identifier: 1973095
2026-03-24 23:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1973095
2026-03-24 23:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1973095
2026-03-24 23:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7eacb2e9-21c7-546e-a8ff-8314d7a7253a with identifier: 1973095 to the API
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7eacb2e9-21c7-546e-a8ff-8314d7a7253a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 120135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973095%27 HTTP/1.1" 200 None
2026-03-24 23:00:44 [ayvens.be] INFO: Saving data for 1973095: {'auction_closing_time': 1774427400.0, 'created_time': 1774003756.65885, 'last_price_update_time': 1774393244.976425}
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973095') HTTP/1.1" 204 0
2026-03-24 23:00:44 [ayvens.be] INFO: Found listing with ID: 1973096
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973096%27 HTTP/1.1" 200 None
2026-03-24 23:00:45 [ayvens.be] INFO: Scrape type for 1973096: 2
2026-03-24 23:00:45 [ayvens.be] INFO: Extracting data for car ID: 1973096
2026-03-24 23:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 511b3176-5270-57aa-96a9-8bea5878c84d with identifier: 1973096
2026-03-24 23:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 511b3176-5270-57aa-96a9-8bea5878c84d with scrape type 2
2026-03-24 23:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 511b3176-5270-57aa-96a9-8bea5878c84d with scrape type 2
2026-03-24 23:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 511b3176-5270-57aa-96a9-8bea5878c84d, identifier: 1973096
2026-03-24 23:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 511b3176-5270-57aa-96a9-8bea5878c84d with identifier: 1973096
2026-03-24 23:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 511b3176-5270-57aa-96a9-8bea5878c84d with identifier: 1973096
2026-03-24 23:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 511b3176-5270-57aa-96a9-8bea5878c84d with identifier: 1973096 to the API
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '511b3176-5270-57aa-96a9-8bea5878c84d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 57767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973096%27 HTTP/1.1" 200 None
2026-03-24 23:00:45 [ayvens.be] INFO: Saving data for 1973096: {'auction_closing_time': 1774427400.0, 'created_time': 1774003758.163454, 'last_price_update_time': 1774393245.445973}
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973096') HTTP/1.1" 204 0
2026-03-24 23:00:45 [ayvens.be] INFO: Found listing with ID: 1973097
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973097%27 HTTP/1.1" 200 None
2026-03-24 23:00:45 [ayvens.be] INFO: Scrape type for 1973097: 2
2026-03-24 23:00:45 [ayvens.be] INFO: Extracting data for car ID: 1973097
2026-03-24 23:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1973097
2026-03-24 23:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with scrape type 2
2026-03-24 23:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with scrape type 2
2026-03-24 23:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb, identifier: 1973097
2026-03-24 23:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1973097
2026-03-24 23:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1973097
2026-03-24 23:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8901dd7c-fe65-538f-9a8d-02dcb9b8fabb with identifier: 1973097 to the API
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8901dd7c-fe65-538f-9a8d-02dcb9b8fabb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY',
 'odometer': 80086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY 1.2I 96KW SWB COMFORT AUTO',
 'transmission': 'automatic',
 'trim': '1.2I 96KW SWB COMFORT AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973097%27 HTTP/1.1" 200 None
2026-03-24 23:00:45 [ayvens.be] INFO: Saving data for 1973097: {'auction_closing_time': 1774427400.0, 'created_time': 1774003760.16756, 'last_price_update_time': 1774393245.973058}
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973097') HTTP/1.1" 204 0
2026-03-24 23:00:45 [ayvens.be] INFO: Found listing with ID: 1973098
2026-03-24 23:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973098%27 HTTP/1.1" 200 None
2026-03-24 23:00:46 [ayvens.be] INFO: Scrape type for 1973098: 2
2026-03-24 23:00:46 [ayvens.be] INFO: Extracting data for car ID: 1973098
2026-03-24 23:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1abd436d-49bc-58dc-8fc6-23da8d69881f with identifier: 1973098
2026-03-24 23:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1abd436d-49bc-58dc-8fc6-23da8d69881f with scrape type 2
2026-03-24 23:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1abd436d-49bc-58dc-8fc6-23da8d69881f with scrape type 2
2026-03-24 23:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1abd436d-49bc-58dc-8fc6-23da8d69881f, identifier: 1973098
2026-03-24 23:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1abd436d-49bc-58dc-8fc6-23da8d69881f with identifier: 1973098
2026-03-24 23:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1abd436d-49bc-58dc-8fc6-23da8d69881f with identifier: 1973098
2026-03-24 23:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1abd436d-49bc-58dc-8fc6-23da8d69881f with identifier: 1973098 to the API
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1abd436d-49bc-58dc-8fc6-23da8d69881f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 161205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 318IA (115KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 318IA (115KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973098%27 HTTP/1.1" 200 None
2026-03-24 23:00:46 [ayvens.be] INFO: Saving data for 1973098: {'auction_closing_time': 1774427400.0, 'created_time': 1774003761.661509, 'last_price_update_time': 1774393246.449332}
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973098') HTTP/1.1" 204 0
2026-03-24 23:00:46 [ayvens.be] INFO: Found listing with ID: 1973099
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973099%27 HTTP/1.1" 200 None
2026-03-24 23:00:46 [ayvens.be] INFO: Scrape type for 1973099: 2
2026-03-24 23:00:46 [ayvens.be] INFO: Extracting data for car ID: 1973099
2026-03-24 23:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be2c0c53-c0b8-50a3-9777-183f5ae23442 with identifier: 1973099
2026-03-24 23:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be2c0c53-c0b8-50a3-9777-183f5ae23442 with scrape type 2
2026-03-24 23:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be2c0c53-c0b8-50a3-9777-183f5ae23442 with scrape type 2
2026-03-24 23:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: be2c0c53-c0b8-50a3-9777-183f5ae23442, identifier: 1973099
2026-03-24 23:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: be2c0c53-c0b8-50a3-9777-183f5ae23442 with identifier: 1973099
2026-03-24 23:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: be2c0c53-c0b8-50a3-9777-183f5ae23442 with identifier: 1973099
2026-03-24 23:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: be2c0c53-c0b8-50a3-9777-183f5ae23442 with identifier: 1973099 to the API
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'be2c0c53-c0b8-50a3-9777-183f5ae23442',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 156722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 GT',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 130 GT',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973099%27 HTTP/1.1" 200 None
2026-03-24 23:00:46 [ayvens.be] INFO: Saving data for 1973099: {'auction_closing_time': 1774427400.0, 'created_time': 1774003764.361067, 'last_price_update_time': 1774393246.863141}
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973099') HTTP/1.1" 204 0
2026-03-24 23:00:46 [ayvens.be] INFO: Found listing with ID: 1973100
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973100%27 HTTP/1.1" 200 None
2026-03-24 23:00:46 [ayvens.be] INFO: Scrape type for 1973100: 2
2026-03-24 23:00:46 [ayvens.be] INFO: Extracting data for car ID: 1973100
2026-03-24 23:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1973100
2026-03-24 23:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with scrape type 2
2026-03-24 23:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with scrape type 2
2026-03-24 23:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b69abcb1-2d81-5245-b20d-dba2e0f2ba47, identifier: 1973100
2026-03-24 23:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1973100
2026-03-24 23:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1973100
2026-03-24 23:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b69abcb1-2d81-5245-b20d-dba2e0f2ba47 with identifier: 1973100 to the API
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b69abcb1-2d81-5245-b20d-dba2e0f2ba47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 128237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973100%27 HTTP/1.1" 200 None
2026-03-24 23:00:47 [ayvens.be] INFO: Saving data for 1973100: {'auction_closing_time': 1774427400.0, 'created_time': 1774003765.678298, 'last_price_update_time': 1774393247.250888}
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973100') HTTP/1.1" 204 0
2026-03-24 23:00:47 [ayvens.be] INFO: Found listing with ID: 1973101
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973101%27 HTTP/1.1" 200 None
2026-03-24 23:00:47 [ayvens.be] INFO: Scrape type for 1973101: 2
2026-03-24 23:00:47 [ayvens.be] INFO: Extracting data for car ID: 1973101
2026-03-24 23:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07f91deb-aaea-55da-8d55-0f162b508985 with identifier: 1973101
2026-03-24 23:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07f91deb-aaea-55da-8d55-0f162b508985 with scrape type 2
2026-03-24 23:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07f91deb-aaea-55da-8d55-0f162b508985 with scrape type 2
2026-03-24 23:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 07f91deb-aaea-55da-8d55-0f162b508985, identifier: 1973101
2026-03-24 23:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 07f91deb-aaea-55da-8d55-0f162b508985 with identifier: 1973101
2026-03-24 23:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 07f91deb-aaea-55da-8d55-0f162b508985 with identifier: 1973101
2026-03-24 23:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 07f91deb-aaea-55da-8d55-0f162b508985 with identifier: 1973101 to the API
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '07f91deb-aaea-55da-8d55-0f162b508985',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 91979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 T6 PHEV R-DESIGN AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV R-DESIGN AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973101%27 HTTP/1.1" 200 None
2026-03-24 23:00:47 [ayvens.be] INFO: Saving data for 1973101: {'auction_closing_time': 1774427400.0, 'created_time': 1774003768.576506, 'last_price_update_time': 1774393247.696646}
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973101') HTTP/1.1" 204 0
2026-03-24 23:00:47 [ayvens.be] INFO: Found listing with ID: 1973102
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973102%27 HTTP/1.1" 200 None
2026-03-24 23:00:47 [ayvens.be] INFO: Scrape type for 1973102: 2
2026-03-24 23:00:47 [ayvens.be] INFO: Extracting data for car ID: 1973102
2026-03-24 23:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a5708b6-5441-5d3c-9019-823c8ec2227d with identifier: 1973102
2026-03-24 23:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a5708b6-5441-5d3c-9019-823c8ec2227d with scrape type 2
2026-03-24 23:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a5708b6-5441-5d3c-9019-823c8ec2227d with scrape type 2
2026-03-24 23:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a5708b6-5441-5d3c-9019-823c8ec2227d, identifier: 1973102
2026-03-24 23:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a5708b6-5441-5d3c-9019-823c8ec2227d with identifier: 1973102
2026-03-24 23:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a5708b6-5441-5d3c-9019-823c8ec2227d with identifier: 1973102
2026-03-24 23:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a5708b6-5441-5d3c-9019-823c8ec2227d with identifier: 1973102 to the API
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': '8a5708b6-5441-5d3c-9019-823c8ec2227d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 55099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 50 KWH ELECTRIQUE AUTO GT LINE',
 'transmission': 'automatic',
 'trim': '50 KWH ELECTRIQUE AUTO GT LINE',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973102%27 HTTP/1.1" 200 None
2026-03-24 23:00:48 [ayvens.be] INFO: Saving data for 1973102: {'auction_closing_time': 1774427400.0, 'created_time': 1774003767.274566, 'last_price_update_time': 1774393248.086029}
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973102') HTTP/1.1" 204 0
2026-03-24 23:00:48 [ayvens.be] INFO: Found listing with ID: 1973103
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973103%27 HTTP/1.1" 200 None
2026-03-24 23:00:48 [ayvens.be] INFO: Scrape type for 1973103: 2
2026-03-24 23:00:48 [ayvens.be] INFO: Extracting data for car ID: 1973103
2026-03-24 23:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1973103
2026-03-24 23:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6992e750-cb41-5f4d-961d-bf0913a096ba with scrape type 2
2026-03-24 23:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6992e750-cb41-5f4d-961d-bf0913a096ba with scrape type 2
2026-03-24 23:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6992e750-cb41-5f4d-961d-bf0913a096ba, identifier: 1973103
2026-03-24 23:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1973103
2026-03-24 23:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1973103
2026-03-24 23:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6992e750-cb41-5f4d-961d-bf0913a096ba with identifier: 1973103 to the API
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '6992e750-cb41-5f4d-961d-bf0913a096ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 29642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI 81KW LIFE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973103%27 HTTP/1.1" 200 None
2026-03-24 23:00:48 [ayvens.be] INFO: Saving data for 1973103: {'auction_closing_time': 1774427400.0, 'created_time': 1774003769.624041, 'last_price_update_time': 1774393248.577454}
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973103') HTTP/1.1" 204 0
2026-03-24 23:00:48 [ayvens.be] INFO: Found listing with ID: 1973104
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973104%27 HTTP/1.1" 200 None
2026-03-24 23:00:48 [ayvens.be] INFO: Scrape type for 1973104: 2
2026-03-24 23:00:48 [ayvens.be] INFO: Extracting data for car ID: 1973104
2026-03-24 23:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75176bfe-fb85-5aa2-80b6-8214099908e2 with identifier: 1973104
2026-03-24 23:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75176bfe-fb85-5aa2-80b6-8214099908e2 with scrape type 2
2026-03-24 23:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75176bfe-fb85-5aa2-80b6-8214099908e2 with scrape type 2
2026-03-24 23:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 75176bfe-fb85-5aa2-80b6-8214099908e2, identifier: 1973104
2026-03-24 23:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 75176bfe-fb85-5aa2-80b6-8214099908e2 with identifier: 1973104
2026-03-24 23:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 75176bfe-fb85-5aa2-80b6-8214099908e2 with identifier: 1973104
2026-03-24 23:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 75176bfe-fb85-5aa2-80b6-8214099908e2 with identifier: 1973104 to the API
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '75176bfe-fb85-5aa2-80b6-8214099908e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 76506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 2.0 30 TDI 85KW',
 'transmission': 'manual',
 'trim': '2.0 30 TDI 85KW',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973104%27 HTTP/1.1" 200 None
2026-03-24 23:00:48 [ayvens.be] INFO: Saving data for 1973104: {'auction_closing_time': 1774427400.0, 'created_time': 1774003772.030326, 'last_price_update_time': 1774393248.970316}
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973104') HTTP/1.1" 204 0
2026-03-24 23:00:48 [ayvens.be] INFO: Found listing with ID: 1973105
2026-03-24 23:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973105%27 HTTP/1.1" 200 None
2026-03-24 23:00:49 [ayvens.be] INFO: Scrape type for 1973105: 2
2026-03-24 23:00:49 [ayvens.be] INFO: Extracting data for car ID: 1973105
2026-03-24 23:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1973105
2026-03-24 23:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with scrape type 2
2026-03-24 23:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with scrape type 2
2026-03-24 23:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d7cf7abd-ce36-549d-ad5b-cb0e608050f4, identifier: 1973105
2026-03-24 23:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1973105
2026-03-24 23:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1973105
2026-03-24 23:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d7cf7abd-ce36-549d-ad5b-cb0e608050f4 with identifier: 1973105 to the API
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd7cf7abd-ce36-549d-ad5b-cb0e608050f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 152619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 2.0 30 TDI S TRONIC BUS.ED. S LINE',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS.ED. S LINE',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973105%27 HTTP/1.1" 200 None
2026-03-24 23:00:49 [ayvens.be] INFO: Saving data for 1973105: {'auction_closing_time': 1774427400.0, 'created_time': 1774003773.077072, 'last_price_update_time': 1774393249.408137}
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973105') HTTP/1.1" 204 0
2026-03-24 23:00:49 [ayvens.be] INFO: Found listing with ID: 1973106
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973106%27 HTTP/1.1" 200 None
2026-03-24 23:00:49 [ayvens.be] INFO: Scrape type for 1973106: 2
2026-03-24 23:00:49 [ayvens.be] INFO: Extracting data for car ID: 1973106
2026-03-24 23:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e0f176-0d61-5f01-8bc1-26fa8edbbaec with identifier: 1973106
2026-03-24 23:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e0f176-0d61-5f01-8bc1-26fa8edbbaec with scrape type 2
2026-03-24 23:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e0f176-0d61-5f01-8bc1-26fa8edbbaec with scrape type 2
2026-03-24 23:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 39e0f176-0d61-5f01-8bc1-26fa8edbbaec, identifier: 1973106
2026-03-24 23:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 39e0f176-0d61-5f01-8bc1-26fa8edbbaec with identifier: 1973106
2026-03-24 23:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 39e0f176-0d61-5f01-8bc1-26fa8edbbaec with identifier: 1973106
2026-03-24 23:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 39e0f176-0d61-5f01-8bc1-26fa8edbbaec with identifier: 1973106 to the API
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '39e0f176-0d61-5f01-8bc1-26fa8edbbaec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Polo',
 'odometer': 16163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Polo 1.0 TSI LIFE',
 'transmission': 'manual',
 'trim': '1.0 TSI LIFE',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973106%27 HTTP/1.1" 200 None
2026-03-24 23:00:49 [ayvens.be] INFO: Saving data for 1973106: {'auction_closing_time': 1774427400.0, 'created_time': 1774003774.734073, 'last_price_update_time': 1774393249.80235}
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973106') HTTP/1.1" 204 0
2026-03-24 23:00:49 [ayvens.be] INFO: Found listing with ID: 1973107
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973107%27 HTTP/1.1" 200 None
2026-03-24 23:00:49 [ayvens.be] INFO: Scrape type for 1973107: 2
2026-03-24 23:00:49 [ayvens.be] INFO: Extracting data for car ID: 1973107
2026-03-24 23:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46df630a-4101-5f3e-8e20-9463d0a49c90 with identifier: 1973107
2026-03-24 23:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46df630a-4101-5f3e-8e20-9463d0a49c90 with scrape type 2
2026-03-24 23:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46df630a-4101-5f3e-8e20-9463d0a49c90 with scrape type 2
2026-03-24 23:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 46df630a-4101-5f3e-8e20-9463d0a49c90, identifier: 1973107
2026-03-24 23:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 46df630a-4101-5f3e-8e20-9463d0a49c90 with identifier: 1973107
2026-03-24 23:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 46df630a-4101-5f3e-8e20-9463d0a49c90 with identifier: 1973107
2026-03-24 23:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 46df630a-4101-5f3e-8e20-9463d0a49c90 with identifier: 1973107 to the API
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.8L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '46df630a-4101-5f3e-8e20-9463d0a49c90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'LAND CRUISER LWB DIESEL - 2013',
 'odometer': 135481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA LAND CRUISER LWB DIESEL - 2013 2.8 D-4D Active Van Aut',
 'transmission': 'automatic',
 'trim': '2.8 D-4D Active Van Aut',
 'vin': None,
 'year': 2017}
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973107%27 HTTP/1.1" 200 None
2026-03-24 23:00:50 [ayvens.be] INFO: Saving data for 1973107: {'auction_closing_time': 1774427400.0, 'created_time': 1774003776.454327, 'last_price_update_time': 1774393250.228828}
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973107') HTTP/1.1" 204 0
2026-03-24 23:00:50 [ayvens.be] INFO: Found listing with ID: 1973108
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973108%27 HTTP/1.1" 200 None
2026-03-24 23:00:50 [ayvens.be] INFO: Scrape type for 1973108: 2
2026-03-24 23:00:50 [ayvens.be] INFO: Extracting data for car ID: 1973108
2026-03-24 23:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82451d3c-8e80-5120-829a-9037c897625d with identifier: 1973108
2026-03-24 23:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82451d3c-8e80-5120-829a-9037c897625d with scrape type 2
2026-03-24 23:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82451d3c-8e80-5120-829a-9037c897625d with scrape type 2
2026-03-24 23:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82451d3c-8e80-5120-829a-9037c897625d, identifier: 1973108
2026-03-24 23:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82451d3c-8e80-5120-829a-9037c897625d with identifier: 1973108
2026-03-24 23:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82451d3c-8e80-5120-829a-9037c897625d with identifier: 1973108
2026-03-24 23:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82451d3c-8e80-5120-829a-9037c897625d with identifier: 1973108 to the API
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '82451d3c-8e80-5120-829a-9037c897625d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY MAXI',
 'odometer': 142830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY MAXI 2.0TDI 90KW BMT MAXI DRIVE DSG',
 'transmission': 'automatic',
 'trim': '2.0TDI 90KW BMT MAXI DRIVE DSG',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973108%27 HTTP/1.1" 200 None
2026-03-24 23:00:50 [ayvens.be] INFO: Saving data for 1973108: {'auction_closing_time': 1774427400.0, 'created_time': 1774003778.005437, 'last_price_update_time': 1774393250.703328}
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973108') HTTP/1.1" 204 0
2026-03-24 23:00:50 [ayvens.be] INFO: Found listing with ID: 1973109
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973109%27 HTTP/1.1" 200 None
2026-03-24 23:00:50 [ayvens.be] INFO: Scrape type for 1973109: 2
2026-03-24 23:00:50 [ayvens.be] INFO: Extracting data for car ID: 1973109
2026-03-24 23:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1973109
2026-03-24 23:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 336ff642-b8c1-548c-a777-d27cc3548c5a with scrape type 2
2026-03-24 23:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 336ff642-b8c1-548c-a777-d27cc3548c5a with scrape type 2
2026-03-24 23:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 336ff642-b8c1-548c-a777-d27cc3548c5a, identifier: 1973109
2026-03-24 23:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1973109
2026-03-24 23:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1973109
2026-03-24 23:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 336ff642-b8c1-548c-a777-d27cc3548c5a with identifier: 1973109 to the API
2026-03-24 23:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': '336ff642-b8c1-548c-a777-d27cc3548c5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 52291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO BEV 65KWH NIRO EV 150KW PURE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 65KWH NIRO EV 150KW PURE AUTO',
 'vin': None,
 'year': 2024}
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973109%27 HTTP/1.1" 200 None
2026-03-24 23:00:51 [ayvens.be] INFO: Saving data for 1973109: {'auction_closing_time': 1774427400.0, 'created_time': 1774003779.766052, 'last_price_update_time': 1774393251.112241}
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973109') HTTP/1.1" 204 0
2026-03-24 23:00:51 [ayvens.be] INFO: Found listing with ID: 1973110
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973110%27 HTTP/1.1" 200 None
2026-03-24 23:00:51 [ayvens.be] INFO: Scrape type for 1973110: 2
2026-03-24 23:00:51 [ayvens.be] INFO: Extracting data for car ID: 1973110
2026-03-24 23:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca10daef-3845-5013-b8e1-e134d511a402 with identifier: 1973110
2026-03-24 23:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca10daef-3845-5013-b8e1-e134d511a402 with scrape type 2
2026-03-24 23:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca10daef-3845-5013-b8e1-e134d511a402 with scrape type 2
2026-03-24 23:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ca10daef-3845-5013-b8e1-e134d511a402, identifier: 1973110
2026-03-24 23:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ca10daef-3845-5013-b8e1-e134d511a402 with identifier: 1973110
2026-03-24 23:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ca10daef-3845-5013-b8e1-e134d511a402 with identifier: 1973110
2026-03-24 23:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ca10daef-3845-5013-b8e1-e134d511a402 with identifier: 1973110 to the API
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'ca10daef-3845-5013-b8e1-e134d511a402',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 98961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973110%27 HTTP/1.1" 200 None
2026-03-24 23:00:51 [ayvens.be] INFO: Saving data for 1973110: {'auction_closing_time': 1774427400.0, 'created_time': 1774003781.802343, 'last_price_update_time': 1774393251.522722}
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973110') HTTP/1.1" 204 0
2026-03-24 23:00:51 [ayvens.be] INFO: Found listing with ID: 1973111
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973111%27 HTTP/1.1" 200 None
2026-03-24 23:00:51 [ayvens.be] INFO: Scrape type for 1973111: 2
2026-03-24 23:00:51 [ayvens.be] INFO: Extracting data for car ID: 1973111
2026-03-24 23:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f297cf70-3659-5235-b08e-e8aae9ff620e with identifier: 1973111
2026-03-24 23:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f297cf70-3659-5235-b08e-e8aae9ff620e with scrape type 2
2026-03-24 23:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f297cf70-3659-5235-b08e-e8aae9ff620e with scrape type 2
2026-03-24 23:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f297cf70-3659-5235-b08e-e8aae9ff620e, identifier: 1973111
2026-03-24 23:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f297cf70-3659-5235-b08e-e8aae9ff620e with identifier: 1973111
2026-03-24 23:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f297cf70-3659-5235-b08e-e8aae9ff620e with identifier: 1973111
2026-03-24 23:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f297cf70-3659-5235-b08e-e8aae9ff620e with identifier: 1973111 to the API
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f297cf70-3659-5235-b08e-e8aae9ff620e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 85254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI 96KW S&S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 96KW S&S ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973111%27 HTTP/1.1" 200 None
2026-03-24 23:00:51 [ayvens.be] INFO: Saving data for 1973111: {'auction_closing_time': 1774427400.0, 'created_time': 1774003783.423324, 'last_price_update_time': 1774393251.940606}
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973111') HTTP/1.1" 204 0
2026-03-24 23:00:51 [ayvens.be] INFO: Found listing with ID: 1973112
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973112%27 HTTP/1.1" 200 None
2026-03-24 23:00:51 [ayvens.be] INFO: Scrape type for 1973112: 2
2026-03-24 23:00:51 [ayvens.be] INFO: Extracting data for car ID: 1973112
2026-03-24 23:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e26bb77c-c958-5a67-b448-060d03b9b83f with identifier: 1973112
2026-03-24 23:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e26bb77c-c958-5a67-b448-060d03b9b83f with scrape type 2
2026-03-24 23:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e26bb77c-c958-5a67-b448-060d03b9b83f with scrape type 2
2026-03-24 23:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e26bb77c-c958-5a67-b448-060d03b9b83f, identifier: 1973112
2026-03-24 23:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e26bb77c-c958-5a67-b448-060d03b9b83f with identifier: 1973112
2026-03-24 23:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e26bb77c-c958-5a67-b448-060d03b9b83f with identifier: 1973112
2026-03-24 23:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e26bb77c-c958-5a67-b448-060d03b9b83f with identifier: 1973112 to the API
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e26bb77c-c958-5a67-b448-060d03b9b83f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN - 2015',
 'odometer': 81630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN - 2015 1.5 TSI ACT Trendline OPF',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Trendline OPF',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973112%27 HTTP/1.1" 200 None
2026-03-24 23:00:52 [ayvens.be] INFO: Saving data for 1973112: {'auction_closing_time': 1774427400.0, 'created_time': 1774003785.087736, 'last_price_update_time': 1774393252.359886}
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973112') HTTP/1.1" 204 0
2026-03-24 23:00:52 [ayvens.be] INFO: Found listing with ID: 1973113
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973113%27 HTTP/1.1" 200 None
2026-03-24 23:00:52 [ayvens.be] INFO: Scrape type for 1973113: 2
2026-03-24 23:00:52 [ayvens.be] INFO: Extracting data for car ID: 1973113
2026-03-24 23:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ea822e5-7192-5ce6-a36c-8d90ada1807d with identifier: 1973113
2026-03-24 23:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea822e5-7192-5ce6-a36c-8d90ada1807d with scrape type 2
2026-03-24 23:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ea822e5-7192-5ce6-a36c-8d90ada1807d with scrape type 2
2026-03-24 23:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4ea822e5-7192-5ce6-a36c-8d90ada1807d, identifier: 1973113
2026-03-24 23:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4ea822e5-7192-5ce6-a36c-8d90ada1807d with identifier: 1973113
2026-03-24 23:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4ea822e5-7192-5ce6-a36c-8d90ada1807d with identifier: 1973113
2026-03-24 23:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4ea822e5-7192-5ce6-a36c-8d90ada1807d with identifier: 1973113 to the API
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 6,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4ea822e5-7192-5ce6-a36c-8d90ada1807d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE FOURGON MWB DSL - 2016',
 'odometer': 122600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE FOURGON MWB DSL - 2016 2.0 D-4D Long Comfort S&S '
          'STOCK',
 'transmission': 'manual',
 'trim': '2.0 D-4D Long Comfort S&S STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973113%27 HTTP/1.1" 200 None
2026-03-24 23:00:52 [ayvens.be] INFO: Saving data for 1973113: {'auction_closing_time': 1774427400.0, 'created_time': 1774003786.950359, 'last_price_update_time': 1774393252.736886}
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973113') HTTP/1.1" 204 0
2026-03-24 23:00:52 [ayvens.be] INFO: Found listing with ID: 1973114
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973114%27 HTTP/1.1" 200 None
2026-03-24 23:00:52 [ayvens.be] INFO: Scrape type for 1973114: 2
2026-03-24 23:00:52 [ayvens.be] INFO: Extracting data for car ID: 1973114
2026-03-24 23:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 909ce41d-da01-5f86-9d02-ed7052a6dca1 with identifier: 1973114
2026-03-24 23:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 909ce41d-da01-5f86-9d02-ed7052a6dca1 with scrape type 2
2026-03-24 23:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 909ce41d-da01-5f86-9d02-ed7052a6dca1 with scrape type 2
2026-03-24 23:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 909ce41d-da01-5f86-9d02-ed7052a6dca1, identifier: 1973114
2026-03-24 23:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 909ce41d-da01-5f86-9d02-ed7052a6dca1 with identifier: 1973114
2026-03-24 23:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 909ce41d-da01-5f86-9d02-ed7052a6dca1 with identifier: 1973114
2026-03-24 23:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 909ce41d-da01-5f86-9d02-ed7052a6dca1 with identifier: 1973114 to the API
2026-03-24 23:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 6,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '909ce41d-da01-5f86-9d02-ed7052a6dca1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE FOURGON MWB DSL - 2016',
 'odometer': 103834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE FOURGON MWB DSL - 2016 2.0 D-4D Long Comfort S&S '
          'STOCK',
 'transmission': 'manual',
 'trim': '2.0 D-4D Long Comfort S&S STOCK',
 'vin': None,
 'year': 2019}
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973114%27 HTTP/1.1" 200 None
2026-03-24 23:00:53 [ayvens.be] INFO: Saving data for 1973114: {'auction_closing_time': 1774427400.0, 'created_time': 1774003788.745839, 'last_price_update_time': 1774393253.150132}
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973114') HTTP/1.1" 204 0
2026-03-24 23:00:53 [ayvens.be] INFO: Found listing with ID: 1973115
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973115%27 HTTP/1.1" 200 None
2026-03-24 23:00:53 [ayvens.be] INFO: Scrape type for 1973115: 2
2026-03-24 23:00:53 [ayvens.be] INFO: Extracting data for car ID: 1973115
2026-03-24 23:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecba8eee-7a73-5268-abfa-dc8a5173e23a with identifier: 1973115
2026-03-24 23:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecba8eee-7a73-5268-abfa-dc8a5173e23a with scrape type 2
2026-03-24 23:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecba8eee-7a73-5268-abfa-dc8a5173e23a with scrape type 2
2026-03-24 23:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ecba8eee-7a73-5268-abfa-dc8a5173e23a, identifier: 1973115
2026-03-24 23:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ecba8eee-7a73-5268-abfa-dc8a5173e23a with identifier: 1973115
2026-03-24 23:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ecba8eee-7a73-5268-abfa-dc8a5173e23a with identifier: 1973115
2026-03-24 23:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ecba8eee-7a73-5268-abfa-dc8a5173e23a with identifier: 1973115 to the API
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ecba8eee-7a73-5268-abfa-dc8a5173e23a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 56754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973115%27 HTTP/1.1" 200 None
2026-03-24 23:00:53 [ayvens.be] INFO: Saving data for 1973115: {'auction_closing_time': 1774427400.0, 'created_time': 1774003789.754294, 'last_price_update_time': 1774393253.532886}
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973115') HTTP/1.1" 204 0
2026-03-24 23:00:53 [ayvens.be] INFO: Found listing with ID: 1973116
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973116%27 HTTP/1.1" 200 None
2026-03-24 23:00:53 [ayvens.be] INFO: Scrape type for 1973116: 2
2026-03-24 23:00:53 [ayvens.be] INFO: Extracting data for car ID: 1973116
2026-03-24 23:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a93bcc54-4fb8-5141-b804-d2b217fd00bb with identifier: 1973116
2026-03-24 23:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a93bcc54-4fb8-5141-b804-d2b217fd00bb with scrape type 2
2026-03-24 23:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a93bcc54-4fb8-5141-b804-d2b217fd00bb with scrape type 2
2026-03-24 23:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a93bcc54-4fb8-5141-b804-d2b217fd00bb, identifier: 1973116
2026-03-24 23:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a93bcc54-4fb8-5141-b804-d2b217fd00bb with identifier: 1973116
2026-03-24 23:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a93bcc54-4fb8-5141-b804-d2b217fd00bb with identifier: 1973116
2026-03-24 23:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a93bcc54-4fb8-5141-b804-d2b217fd00bb with identifier: 1973116 to the API
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a93bcc54-4fb8-5141-b804-d2b217fd00bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 62111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 2.0 30 TDI S TRONIC BUS.ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS.ED. ATTRACTION',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973116%27 HTTP/1.1" 200 None
2026-03-24 23:00:53 [ayvens.be] INFO: Saving data for 1973116: {'auction_closing_time': 1774427400.0, 'created_time': 1774003792.016943, 'last_price_update_time': 1774393253.912199}
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973116') HTTP/1.1" 204 0
2026-03-24 23:00:53 [ayvens.be] INFO: Found listing with ID: 1973117
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973117%27 HTTP/1.1" 200 None
2026-03-24 23:00:53 [ayvens.be] INFO: Scrape type for 1973117: 2
2026-03-24 23:00:53 [ayvens.be] INFO: Extracting data for car ID: 1973117
2026-03-24 23:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 545ad4ec-acb9-582a-a367-cbb42024ab61 with identifier: 1973117
2026-03-24 23:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 545ad4ec-acb9-582a-a367-cbb42024ab61 with scrape type 2
2026-03-24 23:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 545ad4ec-acb9-582a-a367-cbb42024ab61 with scrape type 2
2026-03-24 23:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 545ad4ec-acb9-582a-a367-cbb42024ab61, identifier: 1973117
2026-03-24 23:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 545ad4ec-acb9-582a-a367-cbb42024ab61 with identifier: 1973117
2026-03-24 23:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 545ad4ec-acb9-582a-a367-cbb42024ab61 with identifier: 1973117
2026-03-24 23:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 545ad4ec-acb9-582a-a367-cbb42024ab61 with identifier: 1973117 to the API
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '545ad4ec-acb9-582a-a367-cbb42024ab61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 187198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 B5 D MHEV INSCRIPTION 7PL. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 B5 D MHEV INSCRIPTION 7PL. AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973117%27 HTTP/1.1" 200 None
2026-03-24 23:00:54 [ayvens.be] INFO: Saving data for 1973117: {'auction_closing_time': 1774427400.0, 'created_time': 1774003793.414989, 'last_price_update_time': 1774393254.289524}
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973117') HTTP/1.1" 204 0
2026-03-24 23:00:54 [ayvens.be] INFO: Found listing with ID: 1973118
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973118%27 HTTP/1.1" 200 None
2026-03-24 23:00:54 [ayvens.be] INFO: Scrape type for 1973118: 2
2026-03-24 23:00:54 [ayvens.be] INFO: Extracting data for car ID: 1973118
2026-03-24 23:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3e8de5-a6f9-5644-be74-adb4bc858a14 with identifier: 1973118
2026-03-24 23:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3e8de5-a6f9-5644-be74-adb4bc858a14 with scrape type 2
2026-03-24 23:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf3e8de5-a6f9-5644-be74-adb4bc858a14 with scrape type 2
2026-03-24 23:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cf3e8de5-a6f9-5644-be74-adb4bc858a14, identifier: 1973118
2026-03-24 23:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cf3e8de5-a6f9-5644-be74-adb4bc858a14 with identifier: 1973118
2026-03-24 23:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cf3e8de5-a6f9-5644-be74-adb4bc858a14 with identifier: 1973118
2026-03-24 23:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cf3e8de5-a6f9-5644-be74-adb4bc858a14 with identifier: 1973118 to the API
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cf3e8de5-a6f9-5644-be74-adb4bc858a14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 58217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 96KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973118%27 HTTP/1.1" 200 None
2026-03-24 23:00:54 [ayvens.be] INFO: Saving data for 1973118: {'auction_closing_time': 1774427400.0, 'created_time': 1774003794.806061, 'last_price_update_time': 1774393254.697459}
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973118') HTTP/1.1" 204 0
2026-03-24 23:00:54 [ayvens.be] INFO: Found listing with ID: 1973119
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973119%27 HTTP/1.1" 200 None
2026-03-24 23:00:54 [ayvens.be] INFO: Scrape type for 1973119: 2
2026-03-24 23:00:54 [ayvens.be] INFO: Extracting data for car ID: 1973119
2026-03-24 23:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9961037f-abf0-540f-909b-1b387b9e040a with identifier: 1973119
2026-03-24 23:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9961037f-abf0-540f-909b-1b387b9e040a with scrape type 2
2026-03-24 23:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9961037f-abf0-540f-909b-1b387b9e040a with scrape type 2
2026-03-24 23:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9961037f-abf0-540f-909b-1b387b9e040a, identifier: 1973119
2026-03-24 23:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9961037f-abf0-540f-909b-1b387b9e040a with identifier: 1973119
2026-03-24 23:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9961037f-abf0-540f-909b-1b387b9e040a with identifier: 1973119
2026-03-24 23:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9961037f-abf0-540f-909b-1b387b9e040a with identifier: 1973119 to the API
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '9961037f-abf0-540f-909b-1b387b9e040a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 TOURING DIESEL - 2017',
 'odometer': 101243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 TOURING DIESEL - 2017 518 dA AdBlue',
 'transmission': 'automatic',
 'trim': '518 dA AdBlue',
 'vin': None,
 'year': 2020}
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973119%27 HTTP/1.1" 200 None
2026-03-24 23:00:55 [ayvens.be] INFO: Saving data for 1973119: {'auction_closing_time': 1774427400.0, 'created_time': 1774003796.685813, 'last_price_update_time': 1774393255.188478}
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973119') HTTP/1.1" 204 0
2026-03-24 23:00:55 [ayvens.be] INFO: Found listing with ID: 1973120
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973120%27 HTTP/1.1" 200 None
2026-03-24 23:00:55 [ayvens.be] INFO: Scrape type for 1973120: 2
2026-03-24 23:00:55 [ayvens.be] INFO: Extracting data for car ID: 1973120
2026-03-24 23:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6b5008f-ea63-553a-9819-1139febc0fda with identifier: 1973120
2026-03-24 23:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6b5008f-ea63-553a-9819-1139febc0fda with scrape type 2
2026-03-24 23:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6b5008f-ea63-553a-9819-1139febc0fda with scrape type 2
2026-03-24 23:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6b5008f-ea63-553a-9819-1139febc0fda, identifier: 1973120
2026-03-24 23:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6b5008f-ea63-553a-9819-1139febc0fda with identifier: 1973120
2026-03-24 23:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6b5008f-ea63-553a-9819-1139febc0fda with identifier: 1973120
2026-03-24 23:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6b5008f-ea63-553a-9819-1139febc0fda with identifier: 1973120 to the API
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b6b5008f-ea63-553a-9819-1139febc0fda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'GRAND SCENIC',
 'odometer': 50241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT GRAND SCENIC 1.3 TCE 140 EQUILIBRE',
 'transmission': 'manual',
 'trim': '1.3 TCE 140 EQUILIBRE',
 'vin': None,
 'year': 2023}
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973120%27 HTTP/1.1" 200 None
2026-03-24 23:00:55 [ayvens.be] INFO: Saving data for 1973120: {'auction_closing_time': 1774427400.0, 'created_time': 1774003797.93593, 'last_price_update_time': 1774393255.646702}
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973120') HTTP/1.1" 204 0
2026-03-24 23:00:55 [ayvens.be] INFO: Found listing with ID: 1973121
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973121%27 HTTP/1.1" 200 None
2026-03-24 23:00:55 [ayvens.be] INFO: Scrape type for 1973121: 2
2026-03-24 23:00:55 [ayvens.be] INFO: Extracting data for car ID: 1973121
2026-03-24 23:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1973121
2026-03-24 23:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with scrape type 2
2026-03-24 23:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with scrape type 2
2026-03-24 23:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 89e6be1e-eb40-5242-8521-e6bba00d5ed3, identifier: 1973121
2026-03-24 23:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1973121
2026-03-24 23:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1973121
2026-03-24 23:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 89e6be1e-eb40-5242-8521-e6bba00d5ed3 with identifier: 1973121 to the API
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '89e6be1e-eb40-5242-8521-e6bba00d5ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 54317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E DCT SHOOTING BRAKE',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E DCT SHOOTING BRAKE',
 'vin': None,
 'year': 2021}
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973121%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Saving data for 1973121: {'auction_closing_time': 1774427400.0, 'created_time': 1774003800.796374, 'last_price_update_time': 1774393256.055624}
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973121') HTTP/1.1" 204 0
2026-03-24 23:00:56 [ayvens.be] INFO: Found listing with ID: 1973122
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973122%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Scrape type for 1973122: 2
2026-03-24 23:00:56 [ayvens.be] INFO: Extracting data for car ID: 1973122
2026-03-24 23:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1973122
2026-03-24 23:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d244416-97dd-5dcf-9229-64139a9fcf6e with scrape type 2
2026-03-24 23:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d244416-97dd-5dcf-9229-64139a9fcf6e with scrape type 2
2026-03-24 23:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d244416-97dd-5dcf-9229-64139a9fcf6e, identifier: 1973122
2026-03-24 23:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1973122
2026-03-24 23:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1973122
2026-03-24 23:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d244416-97dd-5dcf-9229-64139a9fcf6e with identifier: 1973122 to the API
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7d244416-97dd-5dcf-9229-64139a9fcf6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'MINI 5 DOOR',
 'odometer': 123903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI MINI 5 DOOR 1.5 ONE',
 'transmission': 'manual',
 'trim': '1.5 ONE',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973122%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Saving data for 1973122: {'auction_closing_time': 1774427400.0, 'created_time': 1774003803.070447, 'last_price_update_time': 1774393256.436901}
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973122') HTTP/1.1" 204 0
2026-03-24 23:00:56 [ayvens.be] INFO: Found listing with ID: 1973123
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973123%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Scrape type for 1973123: 2
2026-03-24 23:00:56 [ayvens.be] INFO: Extracting data for car ID: 1973123
2026-03-24 23:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69756ae-0bae-5239-962a-8fab5436bc96 with identifier: 1973123
2026-03-24 23:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69756ae-0bae-5239-962a-8fab5436bc96 with scrape type 2
2026-03-24 23:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69756ae-0bae-5239-962a-8fab5436bc96 with scrape type 2
2026-03-24 23:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b69756ae-0bae-5239-962a-8fab5436bc96, identifier: 1973123
2026-03-24 23:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b69756ae-0bae-5239-962a-8fab5436bc96 with identifier: 1973123
2026-03-24 23:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b69756ae-0bae-5239-962a-8fab5436bc96 with identifier: 1973123
2026-03-24 23:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b69756ae-0bae-5239-962a-8fab5436bc96 with identifier: 1973123 to the API
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-24 23:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-25T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b69756ae-0bae-5239-962a-8fab5436bc96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40833',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 212201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2022}
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271973123%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Saving data for 1973123: {'auction_closing_time': 1774427400.0, 'created_time': 1774003804.512913, 'last_price_update_time': 1774393256.857011}
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1973123') HTTP/1.1" 204 0
2026-03-24 23:00:56 [ayvens.be] INFO: Found listing with ID: 1970131
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970131%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Scrape type for 1970131: 0
2026-03-24 23:00:56 [ayvens.be] INFO: Found listing with ID: 1970132
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970132%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Scrape type for 1970132: 0
2026-03-24 23:00:56 [ayvens.be] INFO: Found listing with ID: 1970133
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970133%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Scrape type for 1970133: 0
2026-03-24 23:00:56 [ayvens.be] INFO: Found listing with ID: 1970134
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970134%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Scrape type for 1970134: 0
2026-03-24 23:00:56 [ayvens.be] INFO: Found listing with ID: 1970135
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970135%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Scrape type for 1970135: 0
2026-03-24 23:00:56 [ayvens.be] INFO: Found listing with ID: 1970136
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970136%27 HTTP/1.1" 200 None
2026-03-24 23:00:56 [ayvens.be] INFO: Scrape type for 1970136: 0
2026-03-24 23:00:56 [ayvens.be] INFO: Found listing with ID: 1970137
2026-03-24 23:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970137%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970137: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970138
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970138%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970138: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970139
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970139%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970139: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970140
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970140%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970140: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970141
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970141%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970141: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970142
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970142%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970142: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970143
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970143%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970143: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970144
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970144%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970144: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970145
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970145%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970145: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970146
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970146%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970146: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970147
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970147%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970147: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970148
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970148%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970148: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970149
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970149%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970149: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970150
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970150%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970150: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970151
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970151%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970151: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970152
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970152%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970152: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970153
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970153%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970153: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970154
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970154%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970154: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970155
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970155%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970155: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970156
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970156%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970156: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970157
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970157%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970157: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970158
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970158%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970158: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970159
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970159%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970159: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970160
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970160%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970160: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970161
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970161%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970161: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970162
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970162%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970162: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970163
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970163%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970163: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970164
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970164%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970164: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970165
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970165%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970165: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970166
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970166%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970166: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970167
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970167%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970167: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970168
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970168%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970168: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970169
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970169%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970169: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970170
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970170%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970170: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970171
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970171%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970171: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970172
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970172%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970172: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970173
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970173%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970173: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970174
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970174%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970174: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970175
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970175%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970175: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970176
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970176%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970176: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970177
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970177%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970177: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970178
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970178%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970178: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970179
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970179%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970179: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970180
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970180%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970180: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970181
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970181%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970181: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970182
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970182%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970182: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Found listing with ID: 1970183
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970183%27 HTTP/1.1" 200 None
2026-03-24 23:00:57 [ayvens.be] INFO: Scrape type for 1970183: 0
2026-03-24 23:00:57 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1100
2026-03-24 23:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 23:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970184
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970184%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970184: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970185
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970185%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970185: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970186
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970186%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970186: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970187
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970187%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970187: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970188
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970188%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970188: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970189
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970189%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970189: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970190
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970190%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970190: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970191
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970191%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970191: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970192
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970192%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970192: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970193
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970193%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970193: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Found listing with ID: 1970194
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271970194%27 HTTP/1.1" 200 None
2026-03-24 23:01:04 [ayvens.be] INFO: Scrape type for 1970194: 0
2026-03-24 23:01:04 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1200
2026-03-24 23:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-24 23:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-24 23:01:05 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-24 23:01:05 [ayvens.be] INFO: ayvens.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 5, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 64, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20last_price_update_time%20lt%201773961266 HTTP/1.1" 200 None
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972221') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972222') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972223') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972224') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972225') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972226') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972227') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972228') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972229') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972230') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972231') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972232') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972233') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972234') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972235') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972236') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972237') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972238') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972239') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972240') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972241') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972242') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972243') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972244') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972245') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972246') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972247') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972248') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972249') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972250') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972251') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972252') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972253') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972254') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972255') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972256') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972257') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972258') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972259') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972260') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972261') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972262') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972263') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972264') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972265') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972266') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972267') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972268') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972269') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972270') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972271') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972272') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972273') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972274') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972275') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972276') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972277') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972278') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972279') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972280') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972281') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972282') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972283') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972284') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972285') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972286') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972287') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972288') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972289') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972290') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972291') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972292') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972293') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972294') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972295') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972296') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972297') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972298') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972299') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972300') HTTP/1.1" 204 0
2026-03-24 23:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972301') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972302') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972303') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972304') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972305') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972306') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972307') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972308') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972309') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972310') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972311') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972312') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972313') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972314') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972315') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972316') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972317') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972318') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972319') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972320') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972321') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972322') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972323') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972324') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972325') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972326') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972327') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972328') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972329') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972330') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972331') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972332') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972333') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972334') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972335') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972336') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972337') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972338') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972339') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972340') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972341') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972342') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972343') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972344') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972345') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972346') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972347') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972348') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972349') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972350') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972351') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972352') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972353') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972354') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972355') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972356') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972357') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972358') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972359') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972360') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972361') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972362') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972363') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972364') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972365') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972366') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972367') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972368') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972369') HTTP/1.1" 204 0
2026-03-24 23:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='ayvens.be',RowKey='1972370') HTTP/1.1" 204 0
2026-03-24 23:01:07 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (753 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.be/task_34_2026-03-24T22_45_00.jl
2026-03-24 23:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-24 23:01:07 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 2146353,
 'downloader/request_count': 4613,
 'downloader/request_method_count/GET': 4600,
 'downloader/request_method_count/POST': 13,
 'downloader/response_bytes': 2497010305,
 'downloader/response_count': 4613,
 'downloader/response_status_count/200': 4613,
 'elapsed_time_seconds': 961.077494,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 24, 23, 1, 7, 760292, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 753,
 'log_count/DEBUG': 40641,
 'log_count/INFO': 42254,
 'memusage/max': 194293760,
 'memusage/startup': 149803008,
 'photo_download_count': 4599,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 129,
 'playwright/request_count/aborted': 12,
 'playwright/request_count/method/GET': 124,
 'playwright/request_count/method/POST': 5,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 1,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 23,
 'playwright/request_count/resource_type/script': 80,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 6,
 'playwright/response_count': 114,
 'playwright/response_count/method/GET': 111,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 1,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 11,
 'playwright/response_count/resource_type/script': 79,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 13,
 'response_received_count': 14,
 'scheduler/dequeued': 4613,
 'scheduler/dequeued/memory': 4613,
 'scheduler/enqueued': 4613,
 'scheduler/enqueued/memory': 4613,
 'scrape_type/new': 460,
 'scrape_type/price_update': 293,
 'scrape_type/skipped': 358,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 13,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.398875977593259,
 'scrapy-zyte-api/mean_response_seconds': 3.505218568329628,
 'scrapy-zyte-api/processed': 13,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 13,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 13,
 'scrapy-zyte-api/request_args/httpRequestBody': 13,
 'scrapy-zyte-api/request_args/httpRequestMethod': 13,
 'scrapy-zyte-api/request_args/httpResponseBody': 13,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 13,
 'scrapy-zyte-api/request_args/url': 13,
 'scrapy-zyte-api/status_codes/200': 13,
 'scrapy-zyte-api/success': 13,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 24, 22, 45, 6, 682798, tzinfo=datetime.timezone.utc)}
2026-03-24 23:01:07 [scrapy.core.engine] INFO: Spider closed (finished)